-- Logs begin at Thu 2022-09-22 16:26:19 UTC, end at Thu 2022-09-22 17:27:53 UTC. -- Sep 22 16:57:53.558237 dv-cinder-835384-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 16:57:53.569847 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 16:57:53 2022] *** Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: nodename: dv-cinder-835384-28-iscsi Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: machine: x86_64 Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: clock source: unix Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: pcre jit disabled Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: detected number of CPU cores: 4 Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: current working directory: / Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: detected binary path: /usr/bin/uwsgi-core Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: your processes number limit is 47680 Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: your memory page size is 4096 bytes Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: detected max file descriptor number: 2048 Sep 22 16:57:53.572333 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: lock engine: pthread robust mutexes Sep 22 16:57:53.573259 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: thunder lock: enabled Sep 22 16:57:53.573259 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 16:57:53.573259 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 16:57:53.612860 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: Python main interpreter initialized at 0x55a7194a19c0 Sep 22 16:57:53.612860 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: python threads support enabled Sep 22 16:57:53.612860 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: your server socket listen backlog is limited to 100 connections Sep 22 16:57:53.612860 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: your mercy for graceful operations on workers is 90 seconds Sep 22 16:57:53.613310 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 16:57:53.613551 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: *** Operational MODE: preforking *** Sep 22 16:57:53.613980 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: *** uWSGI is running in multiple interpreter mode *** Sep 22 16:57:53.613980 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: spawned uWSGI master process (pid: 105768) Sep 22 16:57:53.614265 dv-cinder-835384-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 16:57:53.615883 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: spawned uWSGI worker 1 (pid: 105769, cores: 1) Sep 22 16:57:53.615883 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: spawned uWSGI worker 2 (pid: 105770, cores: 1) Sep 22 16:57:53.615883 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 16:57:54.327542 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 16:57:54.356078 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 16:57:55.446480 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 16:57:55.446480 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: from cryptography.utils import int_from_bytes Sep 22 16:57:55.447350 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 16:57:55.447350 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: from cryptography.utils import int_from_bytes Sep 22 16:57:55.462515 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 16:57:55.462515 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: from cryptography.utils import int_from_bytes Sep 22 16:57:55.463148 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 16:57:55.463148 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: from cryptography.utils import int_from_bytes Sep 22 16:57:58.077423 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 16:57:58.078301 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 16:57:58.078301 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 16:57:58.078581 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 16:57:58.078773 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 16:57:58.079192 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.079448 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 16:57:58.080154 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.080313 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 16:57:58.080450 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.080450 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.080715 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 16:57:58.080715 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 16:57:58.080964 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.081095 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 16:57:58.081228 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.081373 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.081508 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.081635 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.081777 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.082116 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.082261 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.082403 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.082529 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.082671 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.082796 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.082919 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-28-iscsi {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.083122 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.083251 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.083395 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.083532 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.083656 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.083777 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.084024 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.084150 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.084289 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.084412 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.084560 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.084684 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.085024 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-28-iscsi {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.085156 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.085339 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.085485 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.085686 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.085946 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.086123 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.086298 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.086470 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.086654 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.086843 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.087106 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.087280 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.087464 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.087653 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.087653 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.087985 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.088187 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.088338 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.088474 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.088619 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.088775 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.088930 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.089068 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.089207 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.089207 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.089692 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-28-iscsi {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.089850 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.090048 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.090246 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.090379 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.090574 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.090773 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.091003 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.091205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.091359 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.091564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.091744 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-28-iscsi {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.091890 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.092020 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.092172 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.092314 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.092553 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.092750 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.092901 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.092901 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.093708 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.093855 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.093989 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.094123 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.094262 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.094420 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.094564 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.094716 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.094846 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.095000 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.095190 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.095357 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.095493 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.095635 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.095776 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.095929 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.096082 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.096277 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.096429 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.096570 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.096710 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.096849 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.097006 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.097145 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.097284 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.097421 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.097561 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.097694 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.097860 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.098003 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.098003 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.098266 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.098266 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.098544 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.098677 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.098825 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.098999 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.099161 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.099303 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.099457 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.099457 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.099803 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.099803 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.100113 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.100276 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.100469 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.100615 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.100775 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.100918 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.101118 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.101283 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.101483 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.102371 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.102515 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.102672 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.102877 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.103063 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.103237 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.103379 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.103526 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.103663 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.103811 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.103958 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.104093 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.104228 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.104372 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.104511 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.104664 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.104810 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.104944 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.105105 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.105242 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.105382 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.105535 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.105676 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.105817 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.105817 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.106087 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.106087 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.106356 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.106494 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.106632 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.106632 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.106910 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.107150 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.107292 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.107425 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.107569 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.107707 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.107845 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.107997 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.108140 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.108279 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.108418 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.108559 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.108707 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.108966 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.109122 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.109263 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.109404 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.109546 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.109685 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.109858 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.110054 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.110200 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.110338 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.110484 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.110692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.110832 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.111095 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.111241 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.111436 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.111613 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.111879 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.112024 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.112024 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.112284 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.112424 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.112562 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.112727 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.112878 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.113090 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.113249 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.113395 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.113535 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.113675 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.113808 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.113947 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.114086 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.114227 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.114378 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.114530 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.114687 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.114854 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.115015 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.115154 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.115295 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.115454 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.115603 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.115743 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.115898 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.116037 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.116175 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.116335 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.116473 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.116610 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.116750 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.116896 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.117053 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.117195 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.117348 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.117487 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.117630 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.117772 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.117927 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.118067 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.118207 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.118342 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.118474 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.118612 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.118769 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.118901 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.119081 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.119214 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.119351 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.119484 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.119638 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.119772 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.119906 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.120059 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.120258 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.120395 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.120550 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.120695 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.120902 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.121053 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.121053 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.121383 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.121524 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.121663 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.121787 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.121926 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.122065 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.122216 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.122379 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.122522 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.122658 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.122787 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.122924 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.123230 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.123374 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.123517 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.123653 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.123797 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.123936 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.124097 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.124097 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.124860 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.125004 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.125146 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.125300 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.125452 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.125597 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.125749 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.125893 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.126035 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.126190 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.126334 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.126480 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 16:57:58.126619 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.126619 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.126891 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.127078 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.127222 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.127368 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.127517 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.127662 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.127801 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.127955 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.128093 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.128233 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.128371 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.128521 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.128680 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.128823 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.128973 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.129111 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.129250 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.129425 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.129425 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.129721 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.129880 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.130021 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.130163 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.130301 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.130432 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.130557 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.130683 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.130826 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.131108 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.131250 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.131392 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.131539 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.131690 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.131836 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.131960 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.132086 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.132349 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.132490 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.132630 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.132770 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.132924 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.133061 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.133210 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.133401 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.133540 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.133692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.133831 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.133981 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.134130 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.134278 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.134420 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.134573 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.134718 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.134872 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.135036 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.135180 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.135339 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.135481 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.135636 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.135798 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.135939 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.136081 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.136221 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.136374 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.136516 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.136671 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.136815 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.136958 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.137110 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.137252 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.137396 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.137544 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.137692 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.137842 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.137985 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.138137 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.138291 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.138425 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.138553 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.138695 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.138829 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.139082 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.139294 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.139489 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.139636 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.139636 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.139902 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.140145 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.140306 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.140459 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.140661 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.140812 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.140946 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.141088 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.141217 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.141345 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.141470 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.141603 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.141744 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.141906 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.142103 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.142245 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.142385 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.142527 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.142666 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.142822 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.142990 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.143135 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.143277 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.143418 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.143566 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.143703 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.143838 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.143975 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.144124 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.144413 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.144566 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.144717 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.144857 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.144995 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.145134 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.145293 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.145427 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.145558 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.145704 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.145858 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.145996 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.146146 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.146285 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.146418 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.146557 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.146700 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.146844 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.147067 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.147211 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.147355 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.147527 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.147672 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.147815 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.147972 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.148125 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.148267 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.148419 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.148561 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.148722 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.148861 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.148996 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.149145 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.149284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.149436 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.149580 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.149708 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.149863 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.150005 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.150148 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.150291 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.150445 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.150590 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.150731 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.150877 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.151034 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.151177 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.151337 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.151463 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.151596 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.151717 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.151852 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.151852 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.152128 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.152322 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.152465 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.152606 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.152749 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.152901 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.153041 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.153180 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.153318 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.153456 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.153595 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.153797 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.153944 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.154095 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.154235 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.154406 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.154555 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.154715 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.154859 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.155028 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.155175 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.155317 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.155485 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.156148 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.156293 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.156443 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.156585 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.156727 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.156885 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.157026 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.157172 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.157319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.157461 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.157728 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.157890 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.158046 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.158191 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.158348 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.158493 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.158647 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.158797 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.158939 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.159156 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.159283 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.159404 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.159574 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.159702 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.159827 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.159970 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.160097 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.160225 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.160489 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.160633 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.160777 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.160917 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.161061 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.161203 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.161344 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.161489 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.161616 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.161743 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.161868 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.161868 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.162125 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.162248 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.162378 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.162503 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.162627 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.162750 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.162894 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.163048 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.163165 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.163278 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.163393 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.163520 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.163653 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.163794 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.163913 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.164035 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.164154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.164284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.164284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.164552 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.164680 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.164803 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.164933 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.165073 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.165197 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.165321 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.165459 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.165596 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.165747 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.165880 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.166021 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.166166 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.166312 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.166448 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.166598 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.166741 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.166885 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.167141 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.167283 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.167425 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.167577 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.167722 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.167875 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.168015 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.168141 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.168269 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.168418 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.168535 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.168737 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.168876 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.169058 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.169205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.169378 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.169520 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.169702 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.169913 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.170051 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.170198 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.170337 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.170473 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.170612 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.170772 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.170916 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.171122 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.171328 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.171470 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.171632 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.172010 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.172136 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.172284 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.172438 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.172632 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.172777 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.172921 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.173111 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.173280 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.173421 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.173556 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.173692 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.173840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.173980 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.174187 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.174332 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.174472 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.174608 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.174747 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.174903 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.175093 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.175231 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.175373 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.175513 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.175651 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.175817 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.175958 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.176095 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.176247 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.176397 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.176537 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.176687 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.176827 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.176963 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.177102 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.177258 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.177410 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.177564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.177704 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.177842 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.177989 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.178192 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.178352 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.178490 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.178629 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.178765 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.178912 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.179132 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.179293 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.179442 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.179576 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.179713 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.179846 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.179996 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.180162 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.180297 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.180450 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.180584 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.180771 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.180929 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.181084 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.181237 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.181382 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.181525 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.181668 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.181823 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.181977 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.182174 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.182386 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.182531 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.182674 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.182815 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.183052 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.183195 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.183355 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.183502 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.183645 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.183809 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.183953 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.184105 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.184245 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.184383 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.184528 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.184704 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.184872 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.185036 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.185191 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.185361 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.185513 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.185657 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.185911 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.186055 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.186196 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.186342 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.186484 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.186642 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.187343 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.187675 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.187845 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.187982 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.188119 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.188272 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.188424 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.188574 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.188730 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.188887 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.188887 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.189170 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.189314 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.189457 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.189606 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.189762 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.189904 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.190056 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.190251 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.190390 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.190540 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.190683 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.190818 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.191066 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.191225 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.191364 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.191503 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.191634 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.191786 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.191923 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.192074 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.192222 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.192351 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.192474 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.192665 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.192818 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.192940 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.193056 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.193173 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.193322 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.193456 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.193613 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.193752 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.193887 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.194025 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.194193 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.194336 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.194494 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.194615 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.194803 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.194978 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.195142 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.195286 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.195445 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.195583 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.195762 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.195889 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.196072 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.196251 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.196383 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.196495 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.196673 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.196801 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.196976 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.197134 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.197293 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.197441 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.197601 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.197737 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.197911 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.198072 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.198219 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.198366 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.198502 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.198635 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.198803 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.198990 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.199134 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.199269 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.199432 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.199574 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.199732 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.199870 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.200016 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.200185 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.200340 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.200497 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.200639 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.200829 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.200975 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.201131 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.201271 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.201438 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.201603 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.201744 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.201891 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.202038 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.202178 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.202323 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.202498 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.202718 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.202853 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.203056 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.203181 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.203395 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.203543 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.203685 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.203837 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.203986 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.204125 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.204276 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.204417 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.204556 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.204681 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.204816 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.204940 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.205091 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.205226 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.205409 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.205562 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.205710 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.205855 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.206013 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.206158 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.206293 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.206434 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.206601 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.206756 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.206905 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.207097 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.207236 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.207376 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.207516 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.207677 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.207818 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.207955 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.208098 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.208249 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.208389 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.208542 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.208686 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.208832 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.208977 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.209119 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.209262 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.209426 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.209572 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.209727 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.209866 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.210004 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.210161 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.210301 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.210453 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.210580 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.210704 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.210895 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.211097 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.211241 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.211366 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.211529 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.211665 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.211840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.212105 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.212250 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.212405 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.212546 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.212701 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.212834 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.212984 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.213113 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.213254 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.213404 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.213529 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.213667 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.213809 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.213952 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.214091 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.214242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.214396 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.214561 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.214706 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.214907 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.215128 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.215275 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.215419 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.215581 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.215736 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.215886 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.216029 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.216173 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.216325 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.216481 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.216624 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.216766 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.216909 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.217054 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.217209 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.217351 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.217493 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.217635 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.217778 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.217931 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.218130 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.218291 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.218433 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.218579 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.218720 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.218895 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.219141 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.219286 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.219429 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.219573 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.219716 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.219860 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.220015 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.220161 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.220305 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.220447 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.220583 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.220831 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.220982 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.221126 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.221269 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.221411 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.221553 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.221709 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.221854 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.221996 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.222141 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.222280 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.222418 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.222572 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.222712 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.222898 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.223060 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.223236 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.223385 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.223553 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.223749 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.223900 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.224046 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.224189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.224354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.224511 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.224654 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.224797 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.224941 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.225065 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.225190 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.225370 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.225513 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.225683 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.225832 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.225976 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.226139 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.226290 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.226444 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.226586 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.226728 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.226899 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.227151 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.227297 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.227439 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.227579 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.227720 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.227860 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.228014 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.228167 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.228318 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.228461 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.228606 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.228771 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.228915 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.229057 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.229210 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.229352 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.229496 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.229652 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.229799 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.229954 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.230097 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.230236 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.230374 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.230530 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.230676 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.230818 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.231075 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.231221 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.231390 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.231534 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.231677 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.231814 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.231951 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.232167 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.232324 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.232463 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.232606 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.232773 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.232914 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.233090 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.233227 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.233414 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.233573 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.234251 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.234381 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.234637 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.234799 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.234976 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.235124 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.235299 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.235434 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.235596 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.235739 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.235895 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.236035 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.236175 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.236317 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.236470 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.236631 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.236807 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.236969 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.237113 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.237270 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.237433 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.237707 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.237871 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.238017 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.238172 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.238319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.238466 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.238612 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.238775 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.238921 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.238921 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.239221 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.239383 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.239522 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.239676 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.239819 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.239960 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.240113 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.240260 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.240416 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.240592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.240753 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.240897 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.241043 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.241170 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.241312 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.241465 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.241607 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.241760 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.241902 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.242056 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.242213 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.242353 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.242505 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.242646 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.242790 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.243077 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.243250 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.243391 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.243539 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.243683 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.243822 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.243956 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.244102 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.244243 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.244392 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.244515 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.244638 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.244764 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.244961 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.245094 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.245285 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.245406 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.245648 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.245797 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.245976 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.246118 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.246282 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.246430 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.246602 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.246755 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.246890 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.247070 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.247233 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.247380 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.247532 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.247673 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.247832 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.247973 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.248155 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.248302 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.248445 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.248576 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.248772 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.248917 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.249079 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.249224 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.249475 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.249623 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.249789 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.249929 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.250101 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.250243 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.250397 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.250546 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.250687 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.250826 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.251057 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.251332 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.251475 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.251614 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.251755 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.251897 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.252037 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.252189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.252341 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.252478 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.252616 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.252756 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.252904 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.253061 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.253210 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.253349 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.253473 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.253595 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.253718 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.253858 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.253996 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.254135 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.254286 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.254426 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.254577 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.254703 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.254837 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.255000 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.255170 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.255331 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.255490 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.255615 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.255792 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.255928 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.256095 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.256240 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.256392 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.256574 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.256729 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.256909 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.257051 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.257235 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.257393 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.257534 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.257695 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.257844 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.257986 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.258175 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.258323 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.258465 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.258727 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.258881 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.259150 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.259315 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.259459 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.259598 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.259733 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.259878 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.260013 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.260159 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.260293 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.260423 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.260569 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.260701 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.260846 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.260997 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.261139 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.261280 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.261419 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.261556 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.261690 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.261838 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.262084 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.262215 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.262394 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.262527 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.262707 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.262832 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.263044 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.263169 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.263357 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.263494 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.263679 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.263794 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.263996 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.264135 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.264313 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.264457 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.264626 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.264761 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.265473 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.265647 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.265783 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.265920 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.266105 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.266245 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.266431 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.266568 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.266753 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.266911 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.267111 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.267257 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.267431 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.267573 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.267750 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.267917 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.268054 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.268201 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.268364 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.268503 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.268681 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.268818 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.269006 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.269147 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.269315 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.269583 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.269735 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.269915 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.270056 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.270230 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.270368 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.270538 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.270697 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.270836 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.271003 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.271183 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.271326 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.271485 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.271675 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.271814 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.271961 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.272101 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.272245 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.272394 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.272530 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.272673 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.272824 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.272989 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.273132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.273325 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.273454 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.273645 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.273787 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.273957 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.274097 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.274271 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.274414 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.274587 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.274742 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.274904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.275145 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.275333 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.275477 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.275615 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.275771 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.275971 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.276116 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.276252 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.276414 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.276560 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.276732 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.276885 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.277038 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.277178 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.277365 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.277511 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.277658 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.277811 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.277957 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.278102 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.278257 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.278404 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.278540 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.278698 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.278835 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.279005 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.279189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.279329 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.279488 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.279622 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.279792 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.279930 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.280112 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.280255 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.280501 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.280711 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.280893 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.281058 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.281194 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.281407 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.281558 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.281700 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.282036 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.282191 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.282360 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.282515 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.282672 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.282820 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.283052 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.283195 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.283328 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.283485 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.283624 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.283757 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.283894 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.284085 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.284265 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.284463 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.284669 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.284823 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.284964 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.285093 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.285288 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.285442 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.285624 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.285767 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.285901 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.286030 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.286174 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.286296 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.286435 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.286573 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.286712 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.286845 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.287038 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.287188 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.287340 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.287492 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.287633 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.287771 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.287918 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.288056 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.288202 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.288350 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.288498 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.288637 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.288835 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.288985 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.289166 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.289320 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.289494 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.289650 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.289787 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.289923 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.290090 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.290235 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.290387 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.290534 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.290672 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.290807 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.291080 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.291224 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.291358 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.291515 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.291652 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.291785 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.291961 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.292085 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.292263 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.292416 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.292555 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.292745 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.292886 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.293023 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.293179 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.293320 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.293457 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.293590 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.293776 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.293917 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.294067 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.294203 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.294380 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.294511 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.294689 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.294841 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.295055 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.295331 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.295476 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.295644 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.295779 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.295954 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.296113 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.297070 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.297224 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.297360 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.297500 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.297655 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.297808 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.297946 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.298081 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.298222 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.298370 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.298542 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.298671 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.298871 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.299100 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.299238 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.299381 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.299540 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.299687 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.299832 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.299969 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.300101 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.300237 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.300390 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.300530 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.300669 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.300818 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.300960 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.301118 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.301260 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.301404 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.301543 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.301687 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.301824 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.301965 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.302139 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.302311 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.302432 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.302634 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.302753 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.303087 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.303272 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.303434 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.303611 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.303754 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.303942 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.304066 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.304330 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.304530 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.304670 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.304794 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.304970 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.305109 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.305278 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.305421 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.305586 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.305726 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.305881 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.306006 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.306200 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.306355 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.306528 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.306691 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.306855 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.307075 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.307272 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.307419 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.307562 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.307813 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.307959 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.308109 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.308250 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.308429 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.308548 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.308740 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.308839 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.309060 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.309208 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.309349 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.309489 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.309671 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.309816 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.309969 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.310114 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.310288 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.310551 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.310697 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.310838 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.311030 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.311175 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.311367 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.311560 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.311704 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.311913 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.312071 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.312213 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.312341 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.312480 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.312604 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.312739 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.312872 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.313008 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.313161 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.313301 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.313442 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.313595 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.313737 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.313874 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.314024 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.314163 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.314300 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.314425 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.314651 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.314791 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.314936 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.315233 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.315515 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.315673 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.315857 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.316028 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.316157 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.316280 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.316476 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.316628 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.316772 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.316914 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.317078 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.317214 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.317456 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.317660 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.317794 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.317927 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.318056 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.318188 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.318326 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.318459 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.318592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.318808 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.319056 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.319211 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.319353 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.319487 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.319634 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.319791 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.319944 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.320128 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.320267 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.320485 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.320642 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.320787 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.320986 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.321126 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.321243 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.321433 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.321583 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.321751 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.321879 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.322058 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.322195 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.322365 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.322551 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.322738 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.322878 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.323093 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.323231 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.323387 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.323528 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.323667 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.323806 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.323960 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.324101 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.324261 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.324401 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.324539 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.324717 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.324912 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.325106 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.325257 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.325397 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.325543 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.325681 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.325819 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.325975 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.326108 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.326237 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.326352 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.326470 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.326637 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.326802 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.327007 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.327157 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.327301 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.328025 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.328177 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.328332 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.328472 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.328619 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.328756 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.328906 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.329061 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.329199 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.329337 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.329487 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.329628 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.329769 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.329918 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.330061 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.330258 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.330404 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.330544 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.330683 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.330839 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.331286 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.331489 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.331687 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.331833 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.331975 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.332132 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.332273 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.332419 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.332561 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.332751 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.332916 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.333044 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.333162 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.333286 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.333433 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.333573 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.333727 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.333869 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.334013 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.334163 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.334307 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.334463 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.334626 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.334775 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.334915 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.335097 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.335242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.335388 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.335532 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.335667 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.335792 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.335935 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 16:57:58.336069 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.336211 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.336487 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.336825 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.337140 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.337459 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.337775 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.338091 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.338403 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.338724 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.339066 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.339385 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.339709 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.340031 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.340368 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.340703 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.341018 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.341348 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.341678 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.342038 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.342355 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.342710 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.343101 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.343459 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.343775 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.344092 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 16:57:58.344340 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 16:57:58.493603 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO dbcounter [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Registered counter for database nova_api Sep 22 16:57:58.500115 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO dbcounter [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Registered counter for database nova_api Sep 22 16:57:58.515531 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_db.sqlalchemy.engines [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:57:58.522829 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writer thread running {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:57:58.524300 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:57:58.531860 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writer thread running {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:57:58.582564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.context [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95a4f068-962a-4171-97c1-e00db3557f02(cell1) {{(pid=105769) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 16:57:58.586658 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_concurrency.lockutils [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 16:57:58.587193 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_concurrency.lockutils [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 16:57:58.588845 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_concurrency.lockutils [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 16:57:58.589655 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_concurrency.lockutils [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 16:57:58.590116 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_concurrency.lockutils [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 16:57:58.592292 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_concurrency.lockutils [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 16:57:58.592851 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.context [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95a4f068-962a-4171-97c1-e00db3557f02(cell1) {{(pid=105770) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 16:57:58.595029 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO dbcounter [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Registered counter for database nova_cell0 Sep 22 16:57:58.597664 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 16:57:58.598204 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 16:57:58.599721 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO dbcounter [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Registered counter for database nova_cell1 Sep 22 16:57:58.599947 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 16:57:58.600714 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 16:57:58.601178 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 16:57:58.603441 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 16:57:58.605641 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO dbcounter [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Registered counter for database nova_cell0 Sep 22 16:57:58.608234 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_db.sqlalchemy.engines [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:57:58.610370 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_db.sqlalchemy.engines [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:57:58.610561 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO dbcounter [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Registered counter for database nova_cell1 Sep 22 16:57:58.615371 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writer thread running {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:57:58.619392 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writer thread running {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:57:58.619650 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:57:58.625900 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writer thread running {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:57:58.626695 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:57:58.772492 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO dbcounter [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Registered counter for database nova_cell0 Sep 22 16:57:58.783088 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writer thread running {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:57:58.785532 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG oslo_db.sqlalchemy.engines [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:57:58.791180 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writer thread running {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:57:58.793666 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO dbcounter [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Registered counter for database nova_cell0 Sep 22 16:57:58.806187 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 16:57:58.813463 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writer thread running {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 16:57:59.154856 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: WARNING keystonemiddleware.auth_token [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 16:57:59.157713 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: WARNING keystonemiddleware.auth_token [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 16:57:59.163111 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: WARNING keystonemiddleware.auth_token [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 16:57:59.166194 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: WARNING keystonemiddleware.auth_token [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 16:57:59.512751 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: WARNING keystonemiddleware.auth_token [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 16:57:59.518896 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: WARNING keystonemiddleware.auth_token [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 16:57:59.524271 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7194a19c0 pid: 105770 (default app) Sep 22 16:57:59.526508 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 16:57:59.527672 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: WARNING keystonemiddleware.auth_token [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 16:57:59.527881 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001913 Sep 22 16:57:59.528145 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Thu Sep 22 16:57:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 16:57:59.534462 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: WARNING keystonemiddleware.auth_token [None req-57817420-e1e3-4b00-9f84-139bea930874 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 16:57:59.540292 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7194a19c0 pid: 105769 (default app) Sep 22 16:59:36.008724 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 16:59:36.011202 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002615 Sep 22 16:59:36.012242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 16:59:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 16:59:36.035351 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writing DB stats nova_api:SELECT=3 {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:36.036822 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writing DB stats nova_cell0:SELECT=3 {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:36.038534 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writing DB stats nova_cell1:SELECT=3 {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:36.039789 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:37.206191 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-3b120d63-7abb-45d6-ab33-db660c3ee442 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 16:59:37.242481 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-3b120d63-7abb-45d6-ab33-db660c3ee442 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.218732 Sep 22 16:59:37.243534 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 22 16:59:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 16:59:40.832697 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 16:59:40.834386 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-4b0e8cc4-4487-452d-b74d-875bf16f3cd7 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002319 Sep 22 16:59:40.835351 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 16:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 16:59:41.519888 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-eed11698-21f4-4a5e-8e52-db617a3bf8e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "swap": 0}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:41.577309 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-eed11698-21f4-4a5e-8e52-db617a3bf8e9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.731120 Sep 22 16:59:41.578132 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 16:59:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 16:59:41.599690 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_api:SELECT=3 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:41.601490 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_cell0:SELECT=3 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:41.603261 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_cell1:SELECT=3 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:41.606689 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 16:59:41.964835 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-d8c923d1-877d-41e5-9643-e55693b14877 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:42.040371 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-d8c923d1-877d-41e5-9643-e55693b14877 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.452795 Sep 22 16:59:42.040742 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 22 16:59:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 16:59:45.412439 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-eed11698-21f4-4a5e-8e52-db617a3bf8e9 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 16:59:45.414089 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-eed11698-21f4-4a5e-8e52-db617a3bf8e9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002190 Sep 22 16:59:45.414506 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 16:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 16:59:46.267539 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-c88ba2ca-237f-4695-a84d-71660f246158 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:46.319709 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-c88ba2ca-237f-4695-a84d-71660f246158 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.897628 Sep 22 16:59:46.321585 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 16:59:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 16:59:46.337260 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-9fc415bb-46e4-404f-bbe9-c61a76098852 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:46.391800 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-9fc415bb-46e4-404f-bbe9-c61a76098852 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059301 Sep 22 16:59:46.392716 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 22 16:59:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 16:59:49.255946 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-c88ba2ca-237f-4695-a84d-71660f246158 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 16:59:49.257602 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-c88ba2ca-237f-4695-a84d-71660f246158 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002453 Sep 22 16:59:49.258259 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 16:59:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 16:59:49.804580 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-93e7c52e-57d7-428b-98e8-970bff0d4afe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:49.836682 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-93e7c52e-57d7-428b-98e8-970bff0d4afe admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.567514 Sep 22 16:59:49.837628 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 16:59:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 16:59:49.855144 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-d7e110c8-d7a3-4f62-9b93-2a741f946e88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:49.897525 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-d7e110c8-d7a3-4f62-9b93-2a741f946e88 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047176 Sep 22 16:59:49.897525 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 22 16:59:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 16:59:52.664405 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-93e7c52e-57d7-428b-98e8-970bff0d4afe admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 16:59:52.665430 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-93e7c52e-57d7-428b-98e8-970bff0d4afe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 22 16:59:52.666018 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 16:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 16:59:53.374474 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-833e13ee-0aa1-48d7-af88-fa104510fae8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "swap": 0}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:53.409605 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-833e13ee-0aa1-48d7-af88-fa104510fae8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.734047 Sep 22 16:59:53.411673 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 16:59:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 16:59:53.438678 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-c50296b3-0cb9-479c-bf22-6cb7b193be10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:53.508969 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-c50296b3-0cb9-479c-bf22-6cb7b193be10 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079966 Sep 22 16:59:53.510911 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 22 16:59:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 16:59:56.646405 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-833e13ee-0aa1-48d7-af88-fa104510fae8 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 16:59:56.647475 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-833e13ee-0aa1-48d7-af88-fa104510fae8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 22 16:59:56.648072 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 16:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 16:59:57.315227 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-a38c09da-7921-4fc5-8050-b6291b85b8e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:57.339715 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-a38c09da-7921-4fc5-8050-b6291b85b8e0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.683881 Sep 22 16:59:57.340785 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 16:59:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 16:59:57.353445 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-76bdf8d7-f16b-40ce-9979-9a32638f5da2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 16:59:57.384325 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-76bdf8d7-f16b-40ce-9979-9a32638f5da2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034785 Sep 22 16:59:57.395718 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 22 16:59:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:00:00.367899 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-a38c09da-7921-4fc5-8050-b6291b85b8e0 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:00.368993 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-a38c09da-7921-4fc5-8050-b6291b85b8e0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Sep 22 17:00:00.369401 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 17:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:00.902516 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-b8709ff7-1018-4aa9-89d5-4b70cb74382b admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:00.938568 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-b8709ff7-1018-4aa9-89d5-4b70cb74382b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.561197 Sep 22 17:00:00.939632 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 22 17:00:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:00:03.922835 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-a38c09da-7921-4fc5-8050-b6291b85b8e0 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:03.923903 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-a38c09da-7921-4fc5-8050-b6291b85b8e0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 22 17:00:03.924322 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 17:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:00:04.465319 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-d8b22389-6323-4502-968d-ecde71ede2be admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "vcpus": 1, "id": "1", "name": "m1.tiny"}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:04.498024 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-d8b22389-6323-4502-968d-ecde71ede2be admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.565787 Sep 22 17:00:04.499313 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 17:00:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:00:04.516581 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-fb831863-5673-4f35-a0c3-af3b39d49012 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:04.561165 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-fb831863-5673-4f35-a0c3-af3b39d49012 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052201 Sep 22 17:00:04.561925 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 22 17:00:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:00:07.839808 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-d8b22389-6323-4502-968d-ecde71ede2be admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:07.841599 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-d8b22389-6323-4502-968d-ecde71ede2be admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002979 Sep 22 17:00:07.842427 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 17:00:07 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:08.401625 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-44375734-8393-4f66-bf19-d353764faf39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:08.407802 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:08.426271 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-44375734-8393-4f66-bf19-d353764faf39 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.576538 Sep 22 17:00:08.426832 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 17:00:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 17:00:08.448828 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-dd271426-d899-4025-84e8-aa140a02d33d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:08.492889 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-dd271426-d899-4025-84e8-aa140a02d33d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051106 Sep 22 17:00:08.494205 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 22 17:00:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:00:11.402460 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-44375734-8393-4f66-bf19-d353764faf39 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:11.404414 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-44375734-8393-4f66-bf19-d353764faf39 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002385 Sep 22 17:00:11.405096 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 17:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:12.147428 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-b44b4caa-3e3e-451d-b6e4-774fdbcfa3c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:12.158325 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:12.176735 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-b44b4caa-3e3e-451d-b6e4-774fdbcfa3c9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.764557 Sep 22 17:00:12.177425 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 17:00:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:00:12.197866 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-b8b0fcf4-817c-46be-9f7b-802c1057dade admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:12.235291 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-b8b0fcf4-817c-46be-9f7b-802c1057dade admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043753 Sep 22 17:00:12.236206 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 22 17:00:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:00:15.394541 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-b44b4caa-3e3e-451d-b6e4-774fdbcfa3c9 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:15.395503 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-b44b4caa-3e3e-451d-b6e4-774fdbcfa3c9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 22 17:00:15.399340 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 17:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:16.106106 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-72f3a7bc-5168-430b-9ac5-98903ffd17e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:16.139735 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-72f3a7bc-5168-430b-9ac5-98903ffd17e0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.735464 Sep 22 17:00:16.140914 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 17:00:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:00:16.169290 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-63c0c177-d634-4d5d-ba3a-858ae5dafd9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:16.218917 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-63c0c177-d634-4d5d-ba3a-858ae5dafd9b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058805 Sep 22 17:00:16.219995 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 22 17:00:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:00:20.556649 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-72f3a7bc-5168-430b-9ac5-98903ffd17e0 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:20.558318 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-72f3a7bc-5168-430b-9ac5-98903ffd17e0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Sep 22 17:00:20.558817 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 17:00:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:00:21.163606 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-9b1676ad-e4ab-4367-9d07-82b414d6c506 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "swap": 0, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:21.196682 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-9b1676ad-e4ab-4367-9d07-82b414d6c506 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.628425 Sep 22 17:00:21.207748 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 22 17:00:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 17:00:21.217662 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-63d7d8e2-5058-437a-bf8b-0efa09563430 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:21.256946 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-63d7d8e2-5058-437a-bf8b-0efa09563430 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046688 Sep 22 17:00:21.263624 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 22 17:00:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:00:39.204653 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-9b1676ad-e4ab-4367-9d07-82b414d6c506 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:39.205673 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-9b1676ad-e4ab-4367-9d07-82b414d6c506 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 22 17:00:39.206091 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 17:00:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:39.222395 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:39.695635 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-97241f2b-967c-498c-84fb-4244785475b1 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:39.721306 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-97241f2b-967c-498c-84fb-4244785475b1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.503570 Sep 22 17:00:39.722013 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 22 17:00:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:00:41.204767 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-9b1676ad-e4ab-4367-9d07-82b414d6c506 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:41.206522 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-9b1676ad-e4ab-4367-9d07-82b414d6c506 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002482 Sep 22 17:00:41.207300 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:00:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:41.958911 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-3dfdd3d7-1a46-48b8-b498-7e767abd1623 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:41.968249 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.wsgi [None req-3dfdd3d7-1a46-48b8-b498-7e767abd1623 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-3dfdd3d7-1a46-48b8-b498-7e767abd1623 admin admin] Request method failure captured: Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Accept: application/json Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Accept-Encoding: gzip, deflate Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Connection: keep-alive Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Content-Length: 0 Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Host: 10.222.0.16 Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Openstack-Api-Version: compute 2.92 Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Openstack-System-Scope: None Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: User-Agent: python-novaclient Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Auth-Token: gAAAAABjLJS5MvKUJEfCJdzhX1WcyR0t7NLC498TUXn2KsgqPWbZOxhXXVuyok35xPNOCn0hVIJTmVxymYCQCdCuKGgOP5zH5glQC3QzbzsGs1y9MKoo6i7zL0M71XisF0jDSpctBZ3p3X8wqP8KYWF4dTe_VplfyX6eFP1seMLn3EtbSdnvK2Y Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Domain-Id: None Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Domain-Name: None Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Identity-Status: Confirmed Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Is-Admin-Project: True Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Domain-Id: default Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Domain-Name: Default Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Name: admin Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Role: member,admin,reader Sep 22 17:00:41.974564 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Roles: member,admin,reader Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5aa999029c6348189112ae4315aae1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Tenant: admin Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Tenant-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Tenant-Name: admin Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User: admin Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Domain-Id: default Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Domain-Name: Default Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Id: d723a6acb5a24745b0576ef9d3892945 Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Name: admin Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: method: > Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: exception: Flavor 42 could not be found. Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: action_args: {'id': '42'} Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:00:41.976284 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:41.977114 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:41.978205 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-3dfdd3d7-1a46-48b8-b498-7e767abd1623 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:00:41.980328 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-3dfdd3d7-1a46-48b8-b498-7e767abd1623 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.503748 Sep 22 17:00:41.980328 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 22 17:00:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:41.992319 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-8a0cf044-bcd3-4451-9cf5-941b20fe589f admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:41.999754 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:00:42.039868 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-8a0cf044-bcd3-4451-9cf5-941b20fe589f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.053816 Sep 22 17:00:42.040957 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 22 17:00:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:00:42.055900 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-e7a869cd-02fa-4bfc-bb90-ae56a46a3099 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:42.081446 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-e7a869cd-02fa-4bfc-bb90-ae56a46a3099 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030487 Sep 22 17:00:42.082049 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 22 17:00:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:00:42.092647 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-1eb5b07a-4e6e-4eed-af0a-19b54eb30c7d admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:42.099253 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.wsgi [None req-1eb5b07a-4e6e-4eed-af0a-19b54eb30c7d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-1eb5b07a-4e6e-4eed-af0a-19b54eb30c7d admin admin] Request method failure captured: Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Accept: application/json Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Accept-Encoding: gzip, deflate Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Connection: keep-alive Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Content-Length: 0 Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Host: 10.222.0.16 Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Openstack-Api-Version: compute 2.92 Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Openstack-System-Scope: None Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: User-Agent: python-novaclient Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Auth-Token: gAAAAABjLJS5MvKUJEfCJdzhX1WcyR0t7NLC498TUXn2KsgqPWbZOxhXXVuyok35xPNOCn0hVIJTmVxymYCQCdCuKGgOP5zH5glQC3QzbzsGs1y9MKoo6i7zL0M71XisF0jDSpctBZ3p3X8wqP8KYWF4dTe_VplfyX6eFP1seMLn3EtbSdnvK2Y Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Domain-Id: None Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Domain-Name: None Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Identity-Status: Confirmed Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Is-Admin-Project: True Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Domain-Id: default Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Domain-Name: Default Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Name: admin Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Role: member,admin,reader Sep 22 17:00:42.102621 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Roles: member,admin,reader Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5aa999029c6348189112ae4315aae1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Tenant: admin Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Tenant-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Tenant-Name: admin Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User: admin Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Domain-Id: default Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Domain-Name: Default Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Id: d723a6acb5a24745b0576ef9d3892945 Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Name: admin Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: method: > Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: exception: Flavor 42 could not be found. Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: action_args: {'id': '42'} Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:00:42.104904 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:42.107242 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:42.109623 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-1eb5b07a-4e6e-4eed-af0a-19b54eb30c7d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:00:42.111780 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-1eb5b07a-4e6e-4eed-af0a-19b54eb30c7d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015316 Sep 22 17:00:42.111780 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 22 17:00:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 22 17:00:43.453689 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-e7a869cd-02fa-4bfc-bb90-ae56a46a3099 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:43.455578 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-e7a869cd-02fa-4bfc-bb90-ae56a46a3099 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002417 Sep 22 17:00:43.456329 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:44.129245 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-86a7e7d5-6289-401c-8324-341514ee1b71 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:44.135187 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.wsgi [None req-86a7e7d5-6289-401c-8324-341514ee1b71 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-86a7e7d5-6289-401c-8324-341514ee1b71 admin admin] Request method failure captured: Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Accept: application/json Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Accept-Encoding: gzip, deflate Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Connection: keep-alive Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Content-Length: 0 Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Host: 10.222.0.16 Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Openstack-Api-Version: compute 2.92 Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Openstack-System-Scope: None Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: User-Agent: python-novaclient Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Auth-Token: gAAAAABjLJS7s95At-T9YUERIsd38JLtrzMmsZyDCIHlIHXvLrodKSPpW3x7dZiz3wMU8SFuuoZwKcLHd6ZzFF4Ufda46MSF1ZNuZgvgd_LDHm9EBTPmc8-zPiQcA6KuRn8Fepuzmt3a4oF7xqZd_fKpDPXb5j1Rhaml7PWyvG28X2G1R8SkBD0 Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Domain-Id: None Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Domain-Name: None Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Identity-Status: Confirmed Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Is-Admin-Project: True Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Domain-Id: default Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Domain-Name: Default Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Name: admin Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Role: member,admin,reader Sep 22 17:00:44.136786 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Roles: member,admin,reader Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5aa999029c6348189112ae4315aae1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Tenant: admin Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Tenant-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Tenant-Name: admin Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User: admin Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Domain-Id: default Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Domain-Name: Default Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Id: d723a6acb5a24745b0576ef9d3892945 Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Name: admin Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: method: > Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: exception: Flavor 84 could not be found. Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: action_args: {'id': '84'} Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:00:44.139840 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:44.141692 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-86a7e7d5-6289-401c-8324-341514ee1b71 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:00:44.146632 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-86a7e7d5-6289-401c-8324-341514ee1b71 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.533972 Sep 22 17:00:44.146632 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 22 17:00:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 535 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:44.150373 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-d736b1c2-66f9-473e-82c7-8088d6c442ae admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:44.166724 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-d736b1c2-66f9-473e-82c7-8088d6c442ae admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019992 Sep 22 17:00:44.167558 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 22 17:00:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:00:44.177955 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-0c954824-5716-4780-97e7-c6206202dcaa admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:44.195234 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-0c954824-5716-4780-97e7-c6206202dcaa admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020871 Sep 22 17:00:44.195993 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 22 17:00:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:00:44.206914 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-a9d3155c-9a38-4421-bcb4-b8cdee486c54 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:44.212999 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.wsgi [None req-a9d3155c-9a38-4421-bcb4-b8cdee486c54 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-a9d3155c-9a38-4421-bcb4-b8cdee486c54 admin admin] Request method failure captured: Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Accept: application/json Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Accept-Encoding: gzip, deflate Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Connection: keep-alive Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Content-Length: 0 Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Host: 10.222.0.16 Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Openstack-Api-Version: compute 2.92 Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Openstack-System-Scope: None Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: User-Agent: python-novaclient Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Auth-Token: gAAAAABjLJS7s95At-T9YUERIsd38JLtrzMmsZyDCIHlIHXvLrodKSPpW3x7dZiz3wMU8SFuuoZwKcLHd6ZzFF4Ufda46MSF1ZNuZgvgd_LDHm9EBTPmc8-zPiQcA6KuRn8Fepuzmt3a4oF7xqZd_fKpDPXb5j1Rhaml7PWyvG28X2G1R8SkBD0 Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Domain-Id: None Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Domain-Name: None Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Identity-Status: Confirmed Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Is-Admin-Project: True Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Domain-Id: default Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Domain-Name: Default Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Name: admin Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Role: member,admin,reader Sep 22 17:00:44.215307 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Roles: member,admin,reader Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5aa999029c6348189112ae4315aae1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Tenant: admin Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Tenant-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Tenant-Name: admin Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User: admin Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Domain-Id: default Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Domain-Name: Default Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Id: d723a6acb5a24745b0576ef9d3892945 Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Name: admin Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: method: > Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: exception: Flavor 84 could not be found. Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: action_args: {'id': '84'} Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:00:44.217592 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:44.219189 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:44.221253 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-a9d3155c-9a38-4421-bcb4-b8cdee486c54 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:00:44.223312 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-a9d3155c-9a38-4421-bcb4-b8cdee486c54 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.014052 Sep 22 17:00:44.223755 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 22 17:00:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:45.581076 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-0c954824-5716-4780-97e7-c6206202dcaa admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:45.582216 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-0c954824-5716-4780-97e7-c6206202dcaa admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Sep 22 17:00:45.582712 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:46.195740 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-0c7b4268-aa1c-4915-b910-e5c8cf88dfc6 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:46.202605 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.wsgi [None req-0c7b4268-aa1c-4915-b910-e5c8cf88dfc6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-0c7b4268-aa1c-4915-b910-e5c8cf88dfc6 admin admin] Request method failure captured: Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Accept: application/json Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Accept-Encoding: gzip, deflate Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Connection: keep-alive Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Content-Length: 0 Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Host: 10.222.0.16 Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Openstack-Api-Version: compute 2.92 Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Openstack-System-Scope: None Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: User-Agent: python-novaclient Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Auth-Token: gAAAAABjLJS9lGBTNqwiahWgTFPBFxH3MBesWIoJaXrHeU55CNUOnQdvf8TBVK1F2LkFqsEbkxPHBOzEc0wv1euZpKKjEqJgfJIx2x2j9SSDmfmB1yJcxu1ti5PDZxZJt6kq-isEgj0S2JbtlGHsCNAZvN6vaZBr_t0SrkcortegjV02nV86w78 Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Domain-Id: None Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Domain-Name: None Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Identity-Status: Confirmed Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Is-Admin-Project: True Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Domain-Id: default Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Domain-Name: Default Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Project-Name: admin Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Role: member,admin,reader Sep 22 17:00:46.204226 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Roles: member,admin,reader Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5aa999029c6348189112ae4315aae1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Tenant: admin Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Tenant-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-Tenant-Name: admin Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User: admin Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Domain-Id: default Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Domain-Name: Default Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Id: d723a6acb5a24745b0576ef9d3892945 Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: X-User-Name: admin Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: method: > Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: exception: Flavor 451 could not be found. Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: action_args: {'id': '451'} Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:00:46.205968 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:46.206873 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.208319 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-0c7b4268-aa1c-4915-b910-e5c8cf88dfc6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:00:46.209595 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-0c7b4268-aa1c-4915-b910-e5c8cf88dfc6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.484847 Sep 22 17:00:46.209595 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 22 17:00:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 486 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 22 17:00:46.219517 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-031e280d-eddc-4ec3-b084-154750746fe6 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:46.235865 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-031e280d-eddc-4ec3-b084-154750746fe6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020104 Sep 22 17:00:46.236439 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 22 17:00:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:00:46.247077 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:46.263094 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020051 Sep 22 17:00:46.263784 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 22 17:00:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:00:46.274322 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-0fed871d-a911-4640-b652-ab12fc22c7ea admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:46.279602 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.wsgi [None req-0fed871d-a911-4640-b652-ab12fc22c7ea admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-0fed871d-a911-4640-b652-ab12fc22c7ea admin admin] Request method failure captured: Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Accept: application/json Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Accept-Encoding: gzip, deflate Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Connection: keep-alive Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Content-Length: 0 Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Host: 10.222.0.16 Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Openstack-Api-Version: compute 2.92 Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Openstack-System-Scope: None Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: User-Agent: python-novaclient Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Auth-Token: gAAAAABjLJS9lGBTNqwiahWgTFPBFxH3MBesWIoJaXrHeU55CNUOnQdvf8TBVK1F2LkFqsEbkxPHBOzEc0wv1euZpKKjEqJgfJIx2x2j9SSDmfmB1yJcxu1ti5PDZxZJt6kq-isEgj0S2JbtlGHsCNAZvN6vaZBr_t0SrkcortegjV02nV86w78 Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Domain-Id: None Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Domain-Name: None Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Identity-Status: Confirmed Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Is-Admin-Project: True Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Domain-Id: default Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Domain-Name: Default Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Project-Name: admin Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Role: member,admin,reader Sep 22 17:00:46.281132 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Roles: member,admin,reader Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5aa999029c6348189112ae4315aae1bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5aa999029c6348189112ae4315aae1bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Tenant: admin Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Tenant-Id: 5aa999029c6348189112ae4315aae1bd Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-Tenant-Name: admin Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User: admin Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Domain-Id: default Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Domain-Name: Default Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Id: d723a6acb5a24745b0576ef9d3892945 Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: X-User-Name: admin Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: method: > Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: exception: Flavor 451 could not be found. Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: action_args: {'id': '451'} Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:00:46.283153 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:46.284154 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: ERROR nova.api.openstack.wsgi Sep 22 17:00:46.285354 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-0fed871d-a911-4640-b652-ab12fc22c7ea admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:00:46.286372 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-0fed871d-a911-4640-b652-ab12fc22c7ea admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012426 Sep 22 17:00:46.286372 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 22 17:00:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 17:00:47.634526 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:47.636140 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Sep 22 17:00:47.636551 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:00:48.308255 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-927d21d8-036e-480b-bf8f-7fd460c3e686 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:48.331013 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-927d21d8-036e-480b-bf8f-7fd460c3e686 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.547734 Sep 22 17:00:48.331582 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 22 17:00:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:00:49.682582 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:49.683594 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Sep 22 17:00:49.684024 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:00:50.281897 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-d19d1920-d364-4f1b-ab73-6f7ac77e95aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:50.305135 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-d19d1920-d364-4f1b-ab73-6f7ac77e95aa admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.478477 Sep 22 17:00:50.306204 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 22 17:00:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 17:00:52.410428 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:52.411491 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Sep 22 17:00:52.411941 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:00:53.061950 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-58627f40-0666-468c-b138-cc73e11a48d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:53.085269 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-58627f40-0666-468c-b138-cc73e11a48d2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.531801 Sep 22 17:00:53.085837 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 22 17:00:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:00:54.419457 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:54.420479 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 22 17:00:54.420894 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:55.072515 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-6469cd70-c5d3-4d0b-97e5-a95e5d123555 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:00:55.094001 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-6469cd70-c5d3-4d0b-97e5-a95e5d123555 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.534675 Sep 22 17:00:55.094484 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 22 17:00:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:00:56.468960 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:56.470195 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Sep 22 17:00:56.470685 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:00:57.182445 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-34a0ee2f-1112-4b39-8e05-e5ad0229efbb admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:00:57.206591 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-34a0ee2f-1112-4b39-8e05-e5ad0229efbb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.596843 Sep 22 17:00:57.207204 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Thu Sep 22 17:00:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:01:59.766510 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:01:59.767601 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-546a7a75-66bd-45b8-9de0-1f28db5a7090 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 22 17:01:59.768034 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 22 17:01:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:01:59.790121 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:00.237890 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-c8bd8541-3c44-48b5-ab31-757064b7abe6 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:02:00.261155 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-c8bd8541-3c44-48b5-ab31-757064b7abe6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.480944 Sep 22 17:02:00.261836 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 22 17:01:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:02:00.284278 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writing DB stats nova_api:SELECT=14 {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:02:00.288640 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-6fd63c9e-ba37-4f67-9ba6-9b4319b8dd04 admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:02:00.296861 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-6fd63c9e-ba37-4f67-9ba6-9b4319b8dd04 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014187 Sep 22 17:02:00.297438 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Thu Sep 22 17:02:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:02:00.310917 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-a1f2838a-c63f-4a48-a470-e49e8975b038 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:02:00.321049 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-a1f2838a-c63f-4a48-a470-e49e8975b038 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013044 Sep 22 17:02:00.321049 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Thu Sep 22 17:02:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:02:00.342674 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:02:00.356162 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020429 Sep 22 17:02:00.357187 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Thu Sep 22 17:02:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:02:00.375252 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-7362fb11-865a-4779-b358-4238b21fb138 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:02:00.383230 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-7362fb11-865a-4779-b358-4238b21fb138 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011577 Sep 22 17:02:00.384314 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Thu Sep 22 17:02:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:05:02.019554 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:05:02.020537 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Sep 22 17:05:02.020976 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:05:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:05:02.167605 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_api:SELECT=6 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:05:02.342858 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-ff0f0adc-dbc6-43d8-9263-ea2cf96bdf56 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:05:02.348799 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-ff0f0adc-dbc6-43d8-9263-ea2cf96bdf56 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:05:02.349329 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-ff0f0adc-dbc6-43d8-9263-ea2cf96bdf56 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:05:02.349798 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-ff0f0adc-dbc6-43d8-9263-ea2cf96bdf56 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:05:02.350565 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-ff0f0adc-dbc6-43d8-9263-ea2cf96bdf56 admin admin] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:05:02.351088 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-ff0f0adc-dbc6-43d8-9263-ea2cf96bdf56 admin admin] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:05:02.351547 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-ff0f0adc-dbc6-43d8-9263-ea2cf96bdf56 admin admin] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:05:02.389113 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-ff0f0adc-dbc6-43d8-9263-ea2cf96bdf56 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.222782 Sep 22 17:05:02.389757 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 22 17:05:02 2022] GET /compute/v2.1/os-services => generated 794 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:05:03.609190 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:05:03.610250 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Sep 22 17:05:03.610669 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:05:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:05:03.815807 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-73f8e8e8-0a74-4185-a7eb-e676efa40252 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:05:03.820040 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-73f8e8e8-0a74-4185-a7eb-e676efa40252 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:05:03.820608 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-73f8e8e8-0a74-4185-a7eb-e676efa40252 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:05:03.821182 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-73f8e8e8-0a74-4185-a7eb-e676efa40252 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:05:03.822021 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-73f8e8e8-0a74-4185-a7eb-e676efa40252 admin admin] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:05:03.822523 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-73f8e8e8-0a74-4185-a7eb-e676efa40252 admin admin] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:05:03.823045 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-73f8e8e8-0a74-4185-a7eb-e676efa40252 admin admin] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:05:03.843698 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-73f8e8e8-0a74-4185-a7eb-e676efa40252 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.091314 Sep 22 17:05:03.844292 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 22 17:05:03 2022] GET /compute/v2.1/os-services => generated 794 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:05:15.907666 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:05:15.909214 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Sep 22 17:05:15.909623 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:05:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:05:16.055894 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_cell0:SELECT=4 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:05:16.056564 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_cell1:SELECT=4 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:05:16.057163 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG dbcounter [-] [105770] Writing DB stats nova_api:SELECT=8 {{(pid=105770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:05:16.125035 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-0e6cde75-1210-42ac-8e0e-9df7599c656e admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:05:16.128716 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-0e6cde75-1210-42ac-8e0e-9df7599c656e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:05:16.129202 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-0e6cde75-1210-42ac-8e0e-9df7599c656e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:05:16.129657 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-0e6cde75-1210-42ac-8e0e-9df7599c656e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:05:16.130385 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-0e6cde75-1210-42ac-8e0e-9df7599c656e admin admin] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:05:16.130846 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-0e6cde75-1210-42ac-8e0e-9df7599c656e admin admin] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:05:16.131298 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-0e6cde75-1210-42ac-8e0e-9df7599c656e admin admin] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:05:16.157526 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-0e6cde75-1210-42ac-8e0e-9df7599c656e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.106234 Sep 22 17:05:16.158195 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 22 17:05:16 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:05:17.310898 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG nova.api.openstack.wsgi [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] Calling method '>' {{(pid=105769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:05:17.312186 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: INFO nova.api.openstack.requestlog [None req-3db0269f-2540-4ff0-9491-bc098ecac33c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Sep 22 17:05:17.312644 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: [pid: 105769|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 22 17:05:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:05:17.516244 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG nova.api.openstack.wsgi [None req-3958cc1a-e718-4d0b-becd-120e5230ca23 admin admin] Calling method '>' {{(pid=105770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:05:17.522724 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-3958cc1a-e718-4d0b-becd-120e5230ca23 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:05:17.523544 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-3958cc1a-e718-4d0b-becd-120e5230ca23 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:05:17.524292 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-3958cc1a-e718-4d0b-becd-120e5230ca23 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:05:17.525574 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-3958cc1a-e718-4d0b-becd-120e5230ca23 admin admin] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:05:17.526364 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-3958cc1a-e718-4d0b-becd-120e5230ca23 admin admin] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:05:17.527210 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: DEBUG oslo_concurrency.lockutils [None req-3958cc1a-e718-4d0b-becd-120e5230ca23 admin admin] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:05:17.568742 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: INFO nova.api.openstack.requestlog [None req-3958cc1a-e718-4d0b-becd-120e5230ca23 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.114473 Sep 22 17:05:17.569747 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: [pid: 105770|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 22 17:05:17 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:06:15.987071 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: Thu Sep 22 17:06:15 2022 - graceful shutdown triggered... Sep 22 17:06:15.987189 dv-cinder-835384-28-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 22 17:06:15.988498 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: Gracefully killing worker 1 (pid: 105769)... Sep 22 17:06:15.988985 dv-cinder-835384-28-iscsi devstack@n-api.service[105770]: Gracefully killing worker 2 (pid: 105770)... Sep 22 17:06:16.124157 dv-cinder-835384-28-iscsi devstack@n-api.service[105769]: DEBUG dbcounter [-] [105769] Writing DB stats nova_api:SELECT=4 {{(pid=105769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:06:16.989572 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: worker 1 buried after 1 seconds Sep 22 17:06:16.990280 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: worker 2 buried after 1 seconds Sep 22 17:06:16.990280 dv-cinder-835384-28-iscsi devstack@n-api.service[105768]: goodbye to uWSGI. Sep 22 17:06:16.991554 dv-cinder-835384-28-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 22 17:06:16.992167 dv-cinder-835384-28-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 22 17:06:16.995631 dv-cinder-835384-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 17:06:17.008501 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 17:06:17 2022] *** Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: nodename: dv-cinder-835384-28-iscsi Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: machine: x86_64 Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: clock source: unix Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: pcre jit disabled Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: detected number of CPU cores: 4 Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: current working directory: / Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: detected binary path: /usr/bin/uwsgi-core Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: your processes number limit is 47680 Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: your memory page size is 4096 bytes Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: detected max file descriptor number: 2048 Sep 22 17:06:17.011608 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: lock engine: pthread robust mutexes Sep 22 17:06:17.013127 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: thunder lock: enabled Sep 22 17:06:17.013127 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 17:06:17.013127 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 17:06:17.055179 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: Python main interpreter initialized at 0x557b74ef19c0 Sep 22 17:06:17.055179 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: python threads support enabled Sep 22 17:06:17.055179 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: your server socket listen backlog is limited to 100 connections Sep 22 17:06:17.055179 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: your mercy for graceful operations on workers is 90 seconds Sep 22 17:06:17.055975 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 17:06:17.055975 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: *** Operational MODE: preforking *** Sep 22 17:06:17.055975 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: *** uWSGI is running in multiple interpreter mode *** Sep 22 17:06:17.055975 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: spawned uWSGI master process (pid: 120791) Sep 22 17:06:17.056190 dv-cinder-835384-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 17:06:17.061477 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: spawned uWSGI worker 1 (pid: 120804, cores: 1) Sep 22 17:06:17.061477 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: spawned uWSGI worker 2 (pid: 120805, cores: 1) Sep 22 17:06:17.061477 dv-cinder-835384-28-iscsi devstack@n-api.service[120791]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 17:06:18.182038 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 17:06:18.191661 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 17:06:19.397490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 17:06:19.397490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: from cryptography.utils import int_from_bytes Sep 22 17:06:19.398649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 17:06:19.398649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: from cryptography.utils import int_from_bytes Sep 22 17:06:19.437116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 17:06:19.437116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: from cryptography.utils import int_from_bytes Sep 22 17:06:19.438044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 17:06:19.438044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: from cryptography.utils import int_from_bytes Sep 22 17:06:22.021765 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 17:06:22.022470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 17:06:22.022470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 17:06:22.022851 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 17:06:22.023143 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 17:06:22.023551 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.023884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.024212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.024547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.024890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.025213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.025542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.025861 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.026195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.026467 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.026785 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.027316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-28-iscsi {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.027661 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.027976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.028298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.028628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.028941 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.029274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.029590 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.030110 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.031999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.031999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.031999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.032385 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.032499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.032733 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.033063 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.033374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.033731 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.034025 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.034443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-28-iscsi {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.034773 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.035120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.035445 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.035896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.036218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.036519 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.036846 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.037185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.037511 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.037833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.038175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.038487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.038816 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.039171 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.039485 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.039786 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.040116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.040431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.040742 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.041001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.041318 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.041648 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.041979 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.042309 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.042568 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.042826 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.043181 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.043512 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.043829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.044139 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.044473 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.044768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.045087 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.045392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.045704 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.046016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.046342 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.046675 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.047079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.047395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.047722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.048148 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.048400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.048710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.049060 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.049466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.049788 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.050118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.050712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.051054 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.051372 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.051686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.052017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.052353 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.052665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.052922 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.053230 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.053548 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.053876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.054192 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.054502 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.054819 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.055152 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.055463 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.055773 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.056085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.056396 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.056707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.057022 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.057332 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.057644 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.057958 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.058273 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.058600 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.058926 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.059261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.059577 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.059902 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.060211 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.060540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.060867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.061173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.061505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.061820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.062136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.063093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.063411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.063725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.064059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.064367 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.064681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.065011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.065333 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.065644 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.065955 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.066268 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.066580 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.066893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.067236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.067548 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.067861 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.068176 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.068517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.068837 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.069154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.069466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.069798 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.070156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.070507 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.070860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.071218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.071562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.071902 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.072231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.072676 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.073019 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.073371 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.073747 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.074072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.074398 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.074875 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.075219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.075678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.076014 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.076345 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.076675 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.077000 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.077332 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.077679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.078066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.078538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.079048 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.079495 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.079834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.080178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.080540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.080869 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.081195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.081515 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.081881 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.082205 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.082528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.082868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.083219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.083564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.083885 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.084213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.084531 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.084852 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.085172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.085531 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.085862 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.086194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.086526 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.086845 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.087222 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.087549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.087865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.088183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.088504 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.088814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.089128 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.089442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.089766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.090087 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.090454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.090773 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.091129 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.091460 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.091770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.092090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.092410 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.092726 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.093052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.093370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.094216 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.094564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.094909 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.095231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.095572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.095893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.096208 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.096537 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.096860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.097178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.097514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.097818 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.098154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.098476 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.098795 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.099185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.099523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.099838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.100175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.100509 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.100839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.101155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.101474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.101799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.102126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.102422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.102741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.103092 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.103394 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.103707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.104022 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.104332 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.104672 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.105001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.105310 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.105626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.105933 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.106300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.106612 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.106982 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.107337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.107671 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.108005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.108327 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.108654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.108975 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.109514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.109838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.110159 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.110490 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.110811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.111177 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.111497 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.111841 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.112162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.112490 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.112805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.113130 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.113493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.113834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.114161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.114493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.114814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.115199 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.115488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.115804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.116124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.116444 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.116770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.117089 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.117416 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.117734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.118079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.118395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.118722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.119070 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.119389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.119735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.120077 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.120397 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.120716 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.121054 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.121375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.121694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.122013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.122328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.122642 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.122970 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.123307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.123630 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.123947 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.124262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.124586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.125437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.125773 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.126051 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.126372 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.126717 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.127143 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.127481 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.127836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.128137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.128447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.128829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.129100 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.129414 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.129736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.130045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.130408 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.130727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.131069 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.131513 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.131725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.132044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.132378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.132692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.133009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.133346 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.133671 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.133997 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.134310 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.134632 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.134967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.135290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.135628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.136245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.136245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.136562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.136925 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.137252 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.137507 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.138115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.138467 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.138792 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.139149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.139516 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.139841 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.140186 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.140556 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.140922 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.141245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.141570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.141882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.142210 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.142514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.142827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.143173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.143489 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.143807 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.144134 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.144431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.144742 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.145055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.145380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.145693 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.146099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.146433 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.146746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.147026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.147283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.147596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.147906 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.148261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.148577 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.148935 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.149276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.149790 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.150047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.150425 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.150646 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.150881 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.151225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.151540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.151859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.152178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.152493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.152811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.153130 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.153448 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.153764 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.154073 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.154676 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.154676 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.155186 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.155419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.155640 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.155947 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.156847 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.157086 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.157400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.157713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.158026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.158350 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.158665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.159022 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.159345 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.159664 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.159991 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.160299 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.160639 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.160957 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.161270 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.161589 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.161906 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.162218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.162530 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.162845 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.163199 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.163527 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.163841 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.164157 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.164469 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.164785 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.165093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.165406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.165726 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.166020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.166324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.166633 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.167012 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.167323 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.167634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.167945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.168260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.168388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 17:06:22.168854 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 17:06:22.168995 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.168995 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.169255 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 17:06:22.169382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.169508 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 17:06:22.169644 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.169784 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 17:06:22.169922 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.170051 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.170268 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.170407 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.170545 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.170673 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.170812 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.171137 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.171318 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.171479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.171648 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.171863 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.172037 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.172197 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.172364 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.172522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.172680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.172848 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.173006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.173176 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.173337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.173495 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.173670 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.173670 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.174055 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-28-iscsi {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.174248 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.174428 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.174657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.174818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.174818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.175268 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.175702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.175868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.176218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.176366 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.176507 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.176635 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.176775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.176911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.176911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.177247 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.177459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.177615 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.178035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.178164 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.178308 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.178439 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.178628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.178628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.178991 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.179162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.179355 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.179532 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.179713 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.179887 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.180070 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.180249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.180437 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.180618 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.180797 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.180970 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.181138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.181323 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.181513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-28-iscsi {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.181694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.181871 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.182034 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.182213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.182381 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.182555 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.182739 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.182739 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.183111 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.183297 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.183467 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.183646 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.183830 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.183830 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.184183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.184368 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.184547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.184722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.184906 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.185102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.185290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.185504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.185676 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.185808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.185956 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.186160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.186471 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.186602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.186602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.186854 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.187040 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.187238 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.188305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.188496 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.188634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.188766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.188905 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.189042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.189185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.189314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.189461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.189603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.189730 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.189882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.190021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.190159 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.190309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.190450 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.190450 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.190738 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.190738 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.191074 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.191074 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.191433 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.191636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.191636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.191996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.192182 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.192354 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.192530 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.192530 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.192984 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.193200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.193374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.193579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.193756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.193903 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.193903 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.194209 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.194359 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.194359 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.194599 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.194764 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.194902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.195102 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.195102 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.195444 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.195647 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.195647 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.196154 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.196305 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.196305 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.196663 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.196820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.196820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.197076 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.197205 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.197335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.197470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.197470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.197721 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.197865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.198243 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.198447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.198613 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.198760 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.198920 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.199367 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.199574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.199876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.200096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.200299 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.200561 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.200757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.200995 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.201186 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.201342 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.201596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.201964 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.202141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.202407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.202546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.202740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.203202 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.203404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.203535 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.203764 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.203892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.204135 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.204329 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.204468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.204775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.204911 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.205115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.205444 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.205601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.205777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.205915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.206114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.206330 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.206518 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.206702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.206840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.207078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.207207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.207393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.207643 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.207783 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.208006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.208164 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.208486 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.208655 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.208857 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.209024 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.209152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.209307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.209609 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.209753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.209953 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.210186 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.210371 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.210654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.210833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.211003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.211350 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.211557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.211700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.211908 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.212050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.212266 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.212462 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.212608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.212885 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.213023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.213197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.213511 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.213640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.213824 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.214142 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.214282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.214454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.214733 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.214864 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.215083 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.215354 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.215549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.215714 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.215950 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.216081 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.216348 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.216571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.216738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.216958 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.217152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.217293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.217608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.217748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.217920 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.218260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.218401 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.218645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.218976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.219281 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.219605 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.219972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.220298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.220622 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.220945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.221269 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.221594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.221914 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.222055 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.222236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.222584 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.222733 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.223220 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.223381 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.223575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.223823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.223982 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.224213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.224441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.224577 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.224840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.225031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.225190 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.225597 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.225749 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.225866 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.226107 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.226260 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.226417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.226754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.226916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.227244 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.227384 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.227529 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.227761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.228091 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.228242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.228427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.228734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.229039 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.230248 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.230582 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.230940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.231261 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.231509 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.231755 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.231989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.232235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.232491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.232734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.232973 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.233207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.233443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.233443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.234007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.234763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.234763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.235340 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.235593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.235877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.236362 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.236600 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.236866 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.236866 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.237778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.238040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.238040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.238040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.238810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.239059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.239290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.239509 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.239666 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.239834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.239834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.239834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.240227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.240419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.240587 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.240587 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.241043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.241209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.241484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.241637 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.241927 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.242098 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.242266 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.242417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.242568 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.242736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.242909 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 17:06:22.243157 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.243459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.243631 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.243800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.244130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.244309 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.244479 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.244724 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.245125 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.245404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.245660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.245819 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.245971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.246179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.246558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.246753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.246753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.247172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.247431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.247623 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.247791 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.247940 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.248078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.248373 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.248539 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.248691 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.249474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.249649 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.249805 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.250035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.250035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.250544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.251808 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.251808 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.252193 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.252360 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.252776 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.253066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.253219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.254072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.254233 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.254403 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.254403 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.254869 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.255092 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.255265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.255414 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.255414 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.255700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.255868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.255868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.256153 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.256315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.256464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.256679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.256896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.257099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.257329 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.257689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.257879 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.258074 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.258074 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.258454 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.258667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.258667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.259049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.259262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.259447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.259630 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.259830 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.260047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.260047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.260456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.260637 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.260834 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.261032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.261032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.261430 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.261646 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.261870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.262085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.262085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.262497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.262721 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.262936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.263162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.263365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.263594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.263806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.264024 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.264236 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.264454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.264454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.264857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.265070 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.265285 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.266032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.266244 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.266464 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.266674 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.266870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.266870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.267300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.267502 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.267741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.268100 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.268313 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.268532 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.268746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.268965 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.268965 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.269354 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.269575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.269794 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.270001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.270197 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.270407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.270407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.270809 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.271167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.271407 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.271606 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.271887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.272119 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.272119 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.272516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.272717 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.272933 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.273136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.273364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.273582 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.273582 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.273970 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.274185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.274377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.274578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.274578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.274941 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.275176 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.275334 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.275486 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.275486 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.275852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.276063 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.276278 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.276482 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.276700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.276902 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.276902 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.277302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.277302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.277953 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.277953 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.279711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.279985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.280211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.280427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.280636 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.280869 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.281109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.281391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.281391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.281820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.282065 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.282065 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.282514 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.282756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.283031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.283268 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.283268 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.283739 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.283972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.284201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.284431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.284661 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.284914 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.284914 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.285368 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.285601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.285811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.286031 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.286258 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.286454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.286454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.286862 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.287176 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.287419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.287636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.287636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.288027 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.288234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.288234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.288841 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.289050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.289050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.289451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.289668 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.289878 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.290090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.290090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.290483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.290686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.290686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.291123 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.291322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.291322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.291667 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.291863 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.292061 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.292271 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.292271 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.292640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.292832 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.292832 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.293197 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.293447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.293447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.293447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.293447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.293447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.294513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.294837 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.294837 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.295264 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.295472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.295652 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.295836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.296026 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.296215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.296215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.296597 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.297331 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.297540 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.297742 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.297956 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.298156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.298156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.298544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.298778 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.299205 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.299408 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.299624 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.299853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.300067 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.300265 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.300265 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.300906 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.301108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.301324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.301528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.301528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.301920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.302141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.302342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.302564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.302564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.303003 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.303226 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.303433 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.303645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.303645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.304039 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.304275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.304612 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.304833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.305053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.305261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.305261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.305627 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.305789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.305789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.306165 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.306362 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.306546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.306743 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.307009 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.307219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.307219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.307619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.307824 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.308036 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.308241 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.308457 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.308955 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.308955 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.309349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.309579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.309939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.310155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.310359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.310573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.310789 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.311016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.311016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.311422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.311641 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.311859 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312073 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312280 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312548 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 17:06:22.312759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.312759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.314315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.314315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.314315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.314315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.314315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.314315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.314315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.314315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.315897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.315897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.315897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.315897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.315897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.315897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.315897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.315897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.317305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.317305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.317305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.317305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.317305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.317305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.317305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.317305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.318305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.318305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.318305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.318305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.318790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.321167 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.321167 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.321167 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.321167 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.321971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.321971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.322442 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.322829 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.323587 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.324326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.324866 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.325426 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.326003 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.326565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.327244 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.327814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.328898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.330347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.330347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.330821 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.331480 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.331835 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.332472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.332978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.333542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.334110 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.334707 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.335329 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.335902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.336467 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.337049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.342992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.342992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.342992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.342992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.343751 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.344420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.345039 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.345715 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.346363 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.347595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.348323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.349004 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.349600 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.350550 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.351211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.351711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.352191 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.352793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.353405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.354217 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.354614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.355027 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.355427 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.355844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.356299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.356836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.357450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.358125 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.358790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.360025 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.360648 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.361609 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.362271 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.362905 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.363593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.364286 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.364970 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.365650 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.365832 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO dbcounter [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Registered counter for database nova_api Sep 22 17:06:22.366340 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.367053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.367799 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.368470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.369188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.369884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.370617 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.371456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.372112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.372822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.373506 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.374176 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.374857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.375615 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.376315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.376968 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.378050 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.378735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.379594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.380098 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.380850 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.381577 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.382204 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.382892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.387365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.387365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.387365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.387365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.387365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.387365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.387365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.388380 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.388380 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.389008 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.389400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 17:06:22.389738 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.390408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.391635 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.392314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.393017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.393738 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.394421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.395114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.395768 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.396422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.397082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.397744 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.398306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writer thread running {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 17:06:22.398479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.399146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.399832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.400500 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.401177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.401836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.402516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.403251 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.403941 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.404617 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.405288 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.405939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.406656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.407318 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.408046 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.408699 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.409297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.409931 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.410567 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.411344 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.412028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.412822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.413420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.414107 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.414762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.431402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.431402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.431402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.431402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.431402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.431402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.431402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.431402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.432702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.432702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.432702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.432702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.432702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.432702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.432702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.432702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.433747 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.433747 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.433747 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.433747 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.434460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.434460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.435356 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.436284 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.438159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.445136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.446468 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.447529 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.448537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.449175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.449871 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.450578 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.451220 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.451908 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.452506 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.453653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.454263 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.455157 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.455776 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.456399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.456982 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.457589 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.458463 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.459104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.460163 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.460778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.461595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.462254 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.462803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.463479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.464058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.464587 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.465127 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.context [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95a4f068-962a-4171-97c1-e00db3557f02(cell1) {{(pid=120804) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 17:06:22.465442 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.465764 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.466535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.466899 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.468447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.469168 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.469757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.470030 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:06:22.470301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:06:22.470568 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.471217 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.471826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.472103 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:06:22.472465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.472762 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:06:22.473164 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.473440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:06:22.473702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.474245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.474858 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.475334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:06:22.475609 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.476084 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.476709 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.477193 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.478202 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO dbcounter [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Registered counter for database nova_cell0 Sep 22 17:06:22.478518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.478518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.479133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.479769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.480241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.481265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.481783 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.482396 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.483007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO dbcounter [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Registered counter for database nova_cell1 Sep 22 17:06:22.483292 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.483602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.484936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.485542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.486552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.487218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.487868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.488443 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.488984 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.489538 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.490094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.490677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.491325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.491583 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 17:06:22.491878 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.492464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.493044 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.493882 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.494728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.495589 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.496478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.497325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.498214 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.498351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writer thread running {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 17:06:22.498814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.499047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 17:06:22.499476 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.502151 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.502795 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.503471 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.504074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.504672 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.505274 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.505870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.506543 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.507203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.507759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.508379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.509009 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.509618 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.510242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.510850 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.511475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.512064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.512657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.513262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.513843 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.514397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.515021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.515640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.516217 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.516784 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.517345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.517887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.518460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.519074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.519859 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.520255 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.520868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.521460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.522096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.522622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.523208 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.523858 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.524438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.525045 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.525632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.526239 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.526841 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.527486 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.528104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.528673 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.529237 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.529832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.530430 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.531034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.531712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.532319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.532944 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.533986 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.534595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.535450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.536063 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.536668 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.537269 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.537893 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.538488 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.539144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.539739 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.540350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.540991 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.541608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.542244 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.542879 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.543686 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.545222 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.545802 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.546388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.547708 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.548270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.548837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.549431 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.550020 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.550865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.551466 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.551997 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.552575 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.553175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.553741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.554687 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.554906 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.556660 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.556660 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.556868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.557319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.557926 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.558516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.559103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.560121 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.560700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.561300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.561872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.563063 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.563675 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.564263 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.567082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.567082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.567082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.567082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.567756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.567756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.568431 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.568932 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.569452 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.570059 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.570597 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.571685 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.573831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.573831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.573831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.575216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.575216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.575524 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.575916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.576518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.577119 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.577720 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.578461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.578907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.579534 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.580120 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.580737 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.581264 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.581825 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.582415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.583073 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.583653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.585218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.585218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.589294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.589294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.589294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.589294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.589294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.589294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.589294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.590147 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.590147 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.590573 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.591261 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.592542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.592542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.593434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.594091 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.594692 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.595316 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.595907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.596516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.597476 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.597695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.598365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.598993 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.600464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.600661 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.601264 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.601919 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.602544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.603170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.603766 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.604361 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.605002 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.605575 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.606178 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.606763 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.607403 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.608007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.608593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.609208 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.609793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.610385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.611010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.611616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.612182 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.612746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.613331 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.613912 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.614574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.615219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.615823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.616416 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.616958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.617539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.618117 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.618689 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.619317 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.619948 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.620538 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.621136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.621739 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.622559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.623205 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.623729 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.624300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.625673 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.626594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.627277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.627860 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.628510 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.629087 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.629716 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.630373 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.631015 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.631604 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.632123 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.632688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.633515 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.634300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.634902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.635499 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.636064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.636610 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.637527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.637844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.638296 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.639252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.639820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.640396 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.641524 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.642094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.642679 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.643350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.643903 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.644506 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.645094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.645656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.646223 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.646777 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.647418 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.647905 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.648534 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.649136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.649741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.650343 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.651020 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.651570 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.652124 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.652730 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.653331 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.654112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.654507 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.655143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.655758 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.656387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.656998 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.657771 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.658108 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.658755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.659342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.659960 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.660479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.661091 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.661684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.662298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.662916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.664350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.664958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.665557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.666169 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.666771 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.667391 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.667987 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.668580 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.669262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.669811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.670386 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.672663 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.672663 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.672663 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.673478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.673478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.674023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.674559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.675863 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.676089 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.676713 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.677321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.678081 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.678459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 17:06:22.678895 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120805) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 17:06:22.691666 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writer thread running {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 17:06:22.701120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO dbcounter [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Registered counter for database nova_cell0 Sep 22 17:06:22.709642 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 17:06:22.715240 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writer thread running {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 17:06:22.809358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO dbcounter [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Registered counter for database nova_api Sep 22 17:06:22.845888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_db.sqlalchemy.engines [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 17:06:22.858165 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writer thread running {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 17:06:22.977556 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.context [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95a4f068-962a-4171-97c1-e00db3557f02(cell1) {{(pid=120805) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 17:06:22.988748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:06:22.989576 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:06:22.992600 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:06:22.993827 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:06:22.994629 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:06:22.998663 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:06:23.002984 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO dbcounter [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Registered counter for database nova_cell0 Sep 22 17:06:23.011120 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO dbcounter [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Registered counter for database nova_cell1 Sep 22 17:06:23.024997 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_db.sqlalchemy.engines [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 17:06:23.029009 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_db.sqlalchemy.engines [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 17:06:23.038711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writer thread running {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 17:06:23.050052 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writer thread running {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 17:06:23.070250 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: WARNING keystonemiddleware.auth_token [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 17:06:23.078437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: WARNING keystonemiddleware.auth_token [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 17:06:23.353079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO dbcounter [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Registered counter for database nova_cell0 Sep 22 17:06:23.364289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_db.sqlalchemy.engines [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120805) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 17:06:23.372302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writer thread running {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 17:06:23.433771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: WARNING keystonemiddleware.auth_token [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 17:06:23.440764 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: WARNING keystonemiddleware.auth_token [None req-7ad8be85-6cca-420c-b53c-599d6eb4230f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 17:06:23.446503 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b74ef19c0 pid: 120804 (default app) Sep 22 17:06:23.740729 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: WARNING keystonemiddleware.auth_token [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 17:06:23.748576 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: WARNING keystonemiddleware.auth_token [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 17:06:24.120532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: WARNING keystonemiddleware.auth_token [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 17:06:24.127445 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: WARNING keystonemiddleware.auth_token [None req-c87a39cc-ab0e-4a04-a6bc-c6b3d0d7c454 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 17:06:24.132983 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x557b74ef19c0 pid: 120805 (default app) Sep 22 17:07:03.940662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=3 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:03.941936 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=3 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:03.943121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=3 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:03.944558 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=3 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:04.740410 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:04.745298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:04.747243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:04.757378 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:06.319876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d5b5d636-8639-45ff-a205-0ff665ae5ace tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Action: 'create', calling method: .version_select at 0x7f51da3f24c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1052471574", "metadata": {"Type": "work"}}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:06.628099 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-50ccd1f0-711b-452a-b384-f08d1547e75f tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Action: 'create', calling method: .version_select at 0x7f51da3f0430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-737140818"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:07.684429 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d5b5d636-8639-45ff-a205-0ff665ae5ace tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.763144 Sep 22 17:07:07.685447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 22 17:07:03 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3766 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 22 17:07:07.702560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-54e5c37f-d16a-46c8-ab25-e8d45638aa6f tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Calling method '.version_select at 0x7f51da2c23a0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:07.846682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-54e5c37f-d16a-46c8-ab25-e8d45638aa6f tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb" status: 200 len: 353 microversion: 2.1 time: 0.149122 Sep 22 17:07:07.847394 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:07 2022] GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:07:08.188745 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-50ccd1f0-711b-452a-b384-f08d1547e75f tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.475102 Sep 22 17:07:08.190799 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Sep 22 17:07:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3481 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 22 17:07:08.222214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6e5b2d6d-12a3-414c-b54b-0fb9b1249be7 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da2c2a60>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:08.346059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6e5b2d6d-12a3-414c-b54b-0fb9b1249be7 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4" status: 200 len: 344 microversion: 2.1 time: 0.128828 Sep 22 17:07:08.346657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:08 2022] GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 => generated 344 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:07:08.872915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-df5d3139-13ba-4091-ac5b-2501141ab4be tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Calling method '.version_select at 0x7f51da2c1310>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:08.993880 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-df5d3139-13ba-4091-ac5b-2501141ab4be tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb" status: 200 len: 353 microversion: 2.1 time: 0.128704 Sep 22 17:07:09.004168 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 2/5] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:08 2022] GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:09.367903 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-dd4aefbb-e1e1-405f-9d97-699ddb9f74c2 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da25d1f0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:09.495442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-dd4aefbb-e1e1-405f-9d97-699ddb9f74c2 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4" status: 200 len: 344 microversion: 2.1 time: 0.130895 Sep 22 17:07:09.496876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 4/6] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:09 2022] GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:07:10.017733 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a2fe507e-5108-4e88-b844-b3720d2e3719 tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Calling method '.version_select at 0x7f51da2c1a60>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:10.136675 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a2fe507e-5108-4e88-b844-b3720d2e3719 tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb" status: 200 len: 354 microversion: 2.1 time: 0.127665 Sep 22 17:07:10.137823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:10 2022] GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:10.157121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a29430b8-7a90-42c1-a577-f7f63b1d7bac tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Calling method '.version_select at 0x7f51da2c2b80>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:10.298173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a29430b8-7a90-42c1-a577-f7f63b1d7bac tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb" status: 200 len: 354 microversion: 2.1 time: 0.149748 Sep 22 17:07:10.299635 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:10 2022] GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:10.324854 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d1eb49cc-66e6-43a1-b137-4c90b4a689f9 tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Calling method '.version_select at 0x7f51da25c160>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:10.500335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d1eb49cc-66e6-43a1-b137-4c90b4a689f9 tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb" status: 202 len: 0 microversion: 2.1 time: 0.180539 Sep 22 17:07:10.501493 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 4/9] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:07:10 2022] DELETE /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:07:10.520320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-32553e34-de0d-4836-a1c1-441b1e9be7f8 tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Calling method '.version_select at 0x7f51da2c24c0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:10.525242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7764406f-01ad-48b4-aa70-226b510f2e47 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da2c1b80>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:10.672093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-32553e34-de0d-4836-a1c1-441b1e9be7f8 tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb" status: 200 len: 353 microversion: 2.1 time: 0.164502 Sep 22 17:07:10.673217 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:10 2022] GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:10.808833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7764406f-01ad-48b4-aa70-226b510f2e47 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4" status: 200 len: 345 microversion: 2.1 time: 0.295581 Sep 22 17:07:10.809664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:10 2022] GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 => generated 345 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:10.832960 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7150c9b5-b757-4a27-a22b-2710475f4503 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Action: 'create', calling method: .version_select at 0x7f51da25d310>, body: {"snapshot": {"volume_id": "65a641be-2826-490c-aa0f-997353da25a4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-209045601"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:11.289306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7150c9b5-b757-4a27-a22b-2710475f4503 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.468964 Sep 22 17:07:11.291098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 7/12] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Sep 22 17:07:10 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:07:11.306474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-98fc742b-4a6e-4590-be1c-70762c94c0ca tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da2c1430>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:11.682678 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-98fc742b-4a6e-4590-be1c-70762c94c0ca tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 200 len: 286 microversion: 2.1 time: 0.383511 Sep 22 17:07:11.684286 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:11 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 286 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:11.696227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-aba16283-62d6-4eaa-9b32-821b8d21492b tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Calling method '.version_select at 0x7f51da2c23a0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:11.705125 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-13b6203c-4435-43ec-85fb-0e55e47e80b6 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da25c3a0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:11.770026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-aba16283-62d6-4eaa-9b32-821b8d21492b tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] HTTP exception thrown: Volume fef9e6a7-980e-499e-9d89-3dad71081bcb could not be found. Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-aba16283-62d6-4eaa-9b32-821b8d21492b tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Request method failure captured: Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb HTTP/1.1 Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJY3vNU2Q1BXAwL856P67NbD9XgM7w4vnsHVfS18G8f584gO39XWba9jDHMU3bElZypli_JUv5Bkg1SHABRqaiAlmVNkk4N6sNSSiogpQFwNXKv1qJSqDs5mFzMsSGwRR3qn9rw8T8-3DSoRVP2ZoYLwQx5kfTmqpiXKIQQtT08yav0 Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 7e59a592791b4b5ab8cace0a1a2480cc Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-VolumesGetTestJSON-1356010638 Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:07:11.774720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e59a592791b4b5ab8cace0a1a2480cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7e59a592791b4b5ab8cace0a1a2480cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7e59a592791b4b5ab8cace0a1a2480cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7e59a592791b4b5ab8cace0a1a2480cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-VolumesGetTestJSON-1356010638 Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 7e59a592791b4b5ab8cace0a1a2480cc Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-VolumesGetTestJSON-1356010638 Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-VolumesGetTestJSON-1356010638-project Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 6a18cf0b93804629a11e0f52f6913d33 Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-VolumesGetTestJSON-1356010638-project Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Volume fef9e6a7-980e-499e-9d89-3dad71081bcb could not be found. Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': 'fef9e6a7-980e-499e-9d89-3dad71081bcb'} Sep 22 17:07:11.775829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fef9e6a7-980e-499e-9d89-3dad71081bcb could not be found. (HTTP 404) (Request-ID: req-a2ee395b-d3ab-48a6-b012-7800907b8391) Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:11.776435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:11.783301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fef9e6a7-980e-499e-9d89-3dad71081bcb could not be found. Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 17:07:11.784283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fef9e6a7-980e-499e-9d89-3dad71081bcb could not be found. Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fef9e6a7-980e-499e-9d89-3dad71081bcb could not be found. Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-aba16283-62d6-4eaa-9b32-821b8d21492b tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] Returning 404 to user: Volume fef9e6a7-980e-499e-9d89-3dad71081bcb could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-aba16283-62d6-4eaa-9b32-821b8d21492b tempest-VolumesGetTestJSON-1356010638 tempest-VolumesGetTestJSON-1356010638-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb" status: 404 len: 109 microversion: 2.1 time: 0.084082 Sep 22 17:07:11.785132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 8/14] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:11 2022] GET /compute/v2.1/os-volumes/fef9e6a7-980e-499e-9d89-3dad71081bcb => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:07:11.844267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-13b6203c-4435-43ec-85fb-0e55e47e80b6 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.143886 Sep 22 17:07:11.845606 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1140 bytes} [Thu Sep 22 17:07:11 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:11.858036 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bb6d58e2-19a4-48f4-a39c-676f5aedacc1 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51dac1faf0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:11.984528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bb6d58e2-19a4-48f4-a39c-676f5aedacc1 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 200 len: 286 microversion: 2.1 time: 0.131341 Sep 22 17:07:11.985728 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:11 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:12.998543 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-48132012-2d6b-4061-814b-d8cffb34276d tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da2c1310>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:13.074375 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-48132012-2d6b-4061-814b-d8cffb34276d tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 200 len: 286 microversion: 2.1 time: 0.080325 Sep 22 17:07:13.075644 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:12 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:07:14.097375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0d96592a-b38d-4afa-a663-94c499c3f688 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da2c2310>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:14.207406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0d96592a-b38d-4afa-a663-94c499c3f688 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 200 len: 286 microversion: 2.1 time: 0.117686 Sep 22 17:07:14.212971 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 10/18] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:14 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:15.221293 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-43d55823-64a0-42c1-adc0-2ac2c0d9ed0f tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da2c1af0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:15.296188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-43d55823-64a0-42c1-adc0-2ac2c0d9ed0f tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 200 len: 286 microversion: 2.1 time: 0.079684 Sep 22 17:07:15.296953 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 9/19] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:15 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:16.310471 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b922e61c-a2bf-4402-9a08-cd9f2354925c tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da25ce50>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:16.382995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b922e61c-a2bf-4402-9a08-cd9f2354925c tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 200 len: 286 microversion: 2.1 time: 0.077090 Sep 22 17:07:16.384018 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 10/20] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:16 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:16.680711 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2004317600", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "networks": [{"uuid": "1c6ecb7b-a633-45fb-a85c-5e934221e5c2"}]}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:16.923841 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] validate_networks() for [('1c6ecb7b-a633-45fb-a85c-5e934221e5c2', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:07:17.461992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c0a00956-fced-48ba-bfbe-5c0d56353fc1 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Action: 'create', calling method: .version_select at 0x7f51da25c700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1791989312", "metadata": {"Type": "work"}}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c0a00956-fced-48ba-bfbe-5c0d56353fc1 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Request method failure captured: Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 122 Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZE4EnL8d3AKWQsjFaMGa8AQGK1ZyVr0dxpRZbYklNBjbiMncEYYzH6U5H_cPyZsTPQVxt4L9aF_IN5fse9EtIc32CKbW4jfiQmpcyqJ_EyKhyhw4l9_DMh3qLhkMG3YU3nqxIqMXv-hquGAlMro880_z4Zoaa7SkBsNI01m8056qI Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:07:17.472203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c704cc59df6456ea25ca05356b23384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: e5faa2cd2f4c4c52902d1c21f3388377 Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1791989312", "metadata": {"Type": "work"}}} Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: Sep 22 17:07:17.473420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1791989312', 'metadata': {'Type': 'work'}}}} Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise error Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi '#$%' Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:17.474082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 17:07:17.475907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 17:07:17.476834 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 17:07:17.476834 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.478990 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c0a00956-fced-48ba-bfbe-5c0d56353fc1 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:17.499158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c0a00956-fced-48ba-bfbe-5c0d56353fc1 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.293304 Sep 22 17:07:17.501945 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 11/21] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 22 17:07:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 316 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:07:17.530400 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-874ef29e-0bc2-48c0-96e8-95f8c015eb36 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da25cf70>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:17.603241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-874ef29e-0bc2-48c0-96e8-95f8c015eb36 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 200 len: 286 microversion: 2.1 time: 0.099526 Sep 22 17:07:17.603806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 12/22] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:17 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:17.616838 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fc607d98-0a9d-4dfa-9a4d-e68ca673179a tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Action: 'create', calling method: .version_select at 0x7f51da2200d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1441533264", "metadata": {"Type": "work"}}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fc607d98-0a9d-4dfa-9a4d-e68ca673179a tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Request method failure captured: Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 120 Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZE4EnL8d3AKWQsjFaMGa8AQGK1ZyVr0dxpRZbYklNBjbiMncEYYzH6U5H_cPyZsTPQVxt4L9aF_IN5fse9EtIc32CKbW4jfiQmpcyqJ_EyKhyhw4l9_DMh3qLhkMG3YU3nqxIqMXv-hquGAlMro880_z4Zoaa7SkBsNI01m8056qI Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:07:17.622283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c704cc59df6456ea25ca05356b23384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: e5faa2cd2f4c4c52902d1c21f3388377 Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1441533264", "metadata": {"Type": "work"}}} Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: Sep 22 17:07:17.624012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1441533264', 'metadata': {'Type': 'work'}}}} Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise error Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi '0' Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:17.624625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 17:07:17.625621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 17:07:17.626474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 17:07:17.626474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.630177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fc607d98-0a9d-4dfa-9a4d-e68ca673179a tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:17.631434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fc607d98-0a9d-4dfa-9a4d-e68ca673179a tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018535 Sep 22 17:07:17.632661 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 13/23] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 22 17:07:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:07:17.642838 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e94b3a3f-f92f-4a38-b7d8-cd0cbe0c1aa1 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Action: 'create', calling method: .version_select at 0x7f51da220940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-348026304", "metadata": {"Type": "work"}}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e94b3a3f-f92f-4a38-b7d8-cd0cbe0c1aa1 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Request method failure captured: Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 118 Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZE4EnL8d3AKWQsjFaMGa8AQGK1ZyVr0dxpRZbYklNBjbiMncEYYzH6U5H_cPyZsTPQVxt4L9aF_IN5fse9EtIc32CKbW4jfiQmpcyqJ_EyKhyhw4l9_DMh3qLhkMG3YU3nqxIqMXv-hquGAlMro880_z4Zoaa7SkBsNI01m8056qI Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:07:17.647921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c704cc59df6456ea25ca05356b23384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: e5faa2cd2f4c4c52902d1c21f3388377 Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-348026304", "metadata": {"Type": "work"}}} Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: Sep 22 17:07:17.649014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-348026304', 'metadata': {'Type': 'work'}}}} Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise error Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi '' Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:17.649642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 17:07:17.650670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 17:07:17.651569 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 17:07:17.651569 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.653345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e94b3a3f-f92f-4a38-b7d8-cd0cbe0c1aa1 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:17.655114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e94b3a3f-f92f-4a38-b7d8-cd0cbe0c1aa1 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016631 Sep 22 17:07:17.656212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 14/24] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 22 17:07:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:07:17.666511 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8b06626e-e832-44e4-8e4e-ccd59447469d tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Calling method '.version_select at 0x7f51da25ce50>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:17.738817 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-8b06626e-e832-44e4-8e4e-ccd59447469d tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] HTTP exception thrown: Volume tempest-invalid-229308120 could not be found. Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8b06626e-e832-44e4-8e4e-ccd59447469d tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Request method failure captured: Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-229308120 HTTP/1.1 Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZE4EnL8d3AKWQsjFaMGa8AQGK1ZyVr0dxpRZbYklNBjbiMncEYYzH6U5H_cPyZsTPQVxt4L9aF_IN5fse9EtIc32CKbW4jfiQmpcyqJ_EyKhyhw4l9_DMh3qLhkMG3YU3nqxIqMXv-hquGAlMro880_z4Zoaa7SkBsNI01m8056qI Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:07:17.743406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c704cc59df6456ea25ca05356b23384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: e5faa2cd2f4c4c52902d1c21f3388377 Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Volume tempest-invalid-229308120 could not be found. Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'tempest-invalid-229308120'} Sep 22 17:07:17.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-229308120 could not be found. (HTTP 404) (Request-ID: req-49985174-cdb2-4c6b-92cb-bd02b45bd721) Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.750230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 17:07:17.751170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-229308120 could not be found. Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:07:17.752464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-229308120 could not be found. Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-229308120 could not be found. Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8b06626e-e832-44e4-8e4e-ccd59447469d tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Returning 404 to user: Volume tempest-invalid-229308120 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8b06626e-e832-44e4-8e4e-ccd59447469d tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-229308120" status: 404 len: 98 microversion: 2.1 time: 0.083161 Sep 22 17:07:17.753497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 15/25] 10.222.0.16 () {58 vars in 1215 bytes} [Thu Sep 22 17:07:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-229308120 => generated 98 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 22 17:07:17.766017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6d5ba1cb-aae0-46b8-85a9-79ed6bdd159b tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014452 Sep 22 17:07:17.766479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 16/26] 10.222.0.16 () {58 vars in 1140 bytes} [Thu Sep 22 17:07:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 22 17:07:17.788157 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4e19152d-7681-4bca-8a57-03c90ce6bc0e tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003927 Sep 22 17:07:17.789039 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 17/27] 10.222.0.16 () {58 vars in 1137 bytes} [Thu Sep 22 17:07:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 22 17:07:17.800874 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b0a7fcd4-fc3f-4317-8a62-5c5eee336957 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Calling method '.version_select at 0x7f51da2180d0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:17.865418 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-b0a7fcd4-fc3f-4317-8a62-5c5eee336957 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] HTTP exception thrown: Volume a553e488-0f17-4d4e-a1e4-2933c41e6dbe could not be found. Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b0a7fcd4-fc3f-4317-8a62-5c5eee336957 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Request method failure captured: Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/os-volumes/a553e488-0f17-4d4e-a1e4-2933c41e6dbe HTTP/1.1 Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZE4EnL8d3AKWQsjFaMGa8AQGK1ZyVr0dxpRZbYklNBjbiMncEYYzH6U5H_cPyZsTPQVxt4L9aF_IN5fse9EtIc32CKbW4jfiQmpcyqJ_EyKhyhw4l9_DMh3qLhkMG3YU3nqxIqMXv-hquGAlMro880_z4Zoaa7SkBsNI01m8056qI Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:07:17.868115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c704cc59df6456ea25ca05356b23384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: e5faa2cd2f4c4c52902d1c21f3388377 Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Volume a553e488-0f17-4d4e-a1e4-2933c41e6dbe could not be found. Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'a553e488-0f17-4d4e-a1e4-2933c41e6dbe'} Sep 22 17:07:17.869194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a553e488-0f17-4d4e-a1e4-2933c41e6dbe could not be found. (HTTP 404) (Request-ID: req-ae52a4d9-4403-40b4-b1be-384e9564f72b) Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.869902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 17:07:17.870810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a553e488-0f17-4d4e-a1e4-2933c41e6dbe could not be found. Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 17:07:17.871769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a553e488-0f17-4d4e-a1e4-2933c41e6dbe could not be found. Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a553e488-0f17-4d4e-a1e4-2933c41e6dbe could not be found. Sep 22 17:07:17.872806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:17.875374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b0a7fcd4-fc3f-4317-8a62-5c5eee336957 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Returning 404 to user: Volume a553e488-0f17-4d4e-a1e4-2933c41e6dbe could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:17.876577 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b0a7fcd4-fc3f-4317-8a62-5c5eee336957 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/a553e488-0f17-4d4e-a1e4-2933c41e6dbe" status: 404 len: 109 microversion: 2.1 time: 0.080151 Sep 22 17:07:17.879678 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 18/28] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:07:17 2022] DELETE /compute/v2.1/os-volumes/a553e488-0f17-4d4e-a1e4-2933c41e6dbe => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:07:17.913524 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3715f1fd-2234-430b-aeb1-e127fbfc0656 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Calling method '.version_select at 0x7f51da2201f0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:18.009676 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-3715f1fd-2234-430b-aeb1-e127fbfc0656 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] HTTP exception thrown: Volume f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0 could not be found. Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3715f1fd-2234-430b-aeb1-e127fbfc0656 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Request method failure captured: Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/os-volumes/f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0 HTTP/1.1 Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZE4EnL8d3AKWQsjFaMGa8AQGK1ZyVr0dxpRZbYklNBjbiMncEYYzH6U5H_cPyZsTPQVxt4L9aF_IN5fse9EtIc32CKbW4jfiQmpcyqJ_EyKhyhw4l9_DMh3qLhkMG3YU3nqxIqMXv-hquGAlMro880_z4Zoaa7SkBsNI01m8056qI Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:07:18.017620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c704cc59df6456ea25ca05356b23384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c704cc59df6456ea25ca05356b23384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 9c704cc59df6456ea25ca05356b23384 Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesNegativeTest-1044079083 Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: e5faa2cd2f4c4c52902d1c21f3388377 Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesNegativeTest-1044079083-project Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Volume f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0 could not be found. Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0'} Sep 22 17:07:18.019853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0 could not be found. (HTTP 404) (Request-ID: req-447214c2-8db4-4c67-ac7b-213d515f1926) Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:18.020485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:18.021405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0 could not be found. Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 17:07:18.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0 could not be found. Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0 could not be found. Sep 22 17:07:18.027309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:18.031726 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3715f1fd-2234-430b-aeb1-e127fbfc0656 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] Returning 404 to user: Volume f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:18.033419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3715f1fd-2234-430b-aeb1-e127fbfc0656 tempest-VolumesNegativeTest-1044079083 tempest-VolumesNegativeTest-1044079083-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0" status: 404 len: 109 microversion: 2.1 time: 0.146289 Sep 22 17:07:18.047673 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 19/29] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:17 2022] GET /compute/v2.1/os-volumes/f854b1b3-7ac0-41dc-be5a-9a5d157ee9a0 => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:07:18.618816 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2d8cd36a-76a8-49e0-aea9-c9c31549c2e3 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da218040>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:18.689421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2d8cd36a-76a8-49e0-aea9-c9c31549c2e3 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 200 len: 287 microversion: 2.1 time: 0.075840 Sep 22 17:07:18.689835 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 20/30] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:18 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:18.729134 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fc46f77d-fdf4-4e7d-9a69-90986a1f9682 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da1f6160>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:18.970062 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fc46f77d-fdf4-4e7d-9a69-90986a1f9682 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 202 len: 0 microversion: 2.1 time: 0.269833 Sep 22 17:07:18.971717 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 21/31] 10.222.0.16 () {58 vars in 1254 bytes} [Thu Sep 22 17:07:18 2022] DELETE /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:07:18.998308 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-17ad7d11-95be-4cc6-8306-7fc42f4ed349 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da218040>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:19.140689 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-17ad7d11-95be-4cc6-8306-7fc42f4ed349 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 200 len: 286 microversion: 2.1 time: 0.162432 Sep 22 17:07:19.156173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 22/32] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:18 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:20.157811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-56407dc6-5c77-4cef-a56e-613977229958 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da218a60>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:20.227390 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-56407dc6-5c77-4cef-a56e-613977229958 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] HTTP exception thrown: Snapshot 4570a23a-8ac8-4dad-929a-53422e42f341 could not be found. Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-56407dc6-5c77-4cef-a56e-613977229958 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Request method failure captured: Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 HTTP/1.1 Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJY4sARkGGdzEVCwvLbLdOYReq52LnrsUe1x5Dt_oZ1sEP-Lu-pXk065WGqan7kkm7tq5BfPFzxd2ERB9xzgtqXDVg2dMVFN0txRYn1GDpCz92g1l9Hy-Br-qQFwsgH5O4K7fIhttY8fiE_09YF01Kccf7bQ1EhK7P4wB82Q5TWp8ks Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 329d492f457d4bc6bf63ff3eb5971826 Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:07:20.230399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 329d492f457d4bc6bf63ff3eb5971826 Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-VolumesSnapshotsTestJSON-1790464045-project Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: a716e14c35014a728f0dc76675ff6874 Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1790464045-project Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Snapshot 4570a23a-8ac8-4dad-929a-53422e42f341 could not be found. Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '4570a23a-8ac8-4dad-929a-53422e42f341'} Sep 22 17:07:20.232955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4570a23a-8ac8-4dad-929a-53422e42f341 could not be found. (HTTP 404) (Request-ID: req-0115cd7a-a73b-4c21-a4c3-4b1d5d9067ac) Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:20.233887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:20.234735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4570a23a-8ac8-4dad-929a-53422e42f341 could not be found. Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 22 17:07:20.235722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4570a23a-8ac8-4dad-929a-53422e42f341 could not be found. Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4570a23a-8ac8-4dad-929a-53422e42f341 could not be found. Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-56407dc6-5c77-4cef-a56e-613977229958 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Returning 404 to user: Snapshot 4570a23a-8ac8-4dad-929a-53422e42f341 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:20.238586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-56407dc6-5c77-4cef-a56e-613977229958 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341" status: 404 len: 111 microversion: 2.1 time: 0.078596 Sep 22 17:07:20.240284 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 23/33] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:07:20 2022] GET /compute/v2.1/os-snapshots/4570a23a-8ac8-4dad-929a-53422e42f341 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:07:20.246388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e2a67df5-b8a3-4fa0-adbc-a43f9e55d0b8 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da220820>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:20.423083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e2a67df5-b8a3-4fa0-adbc-a43f9e55d0b8 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4" status: 202 len: 0 microversion: 2.1 time: 0.184029 Sep 22 17:07:20.429823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 24/34] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:07:20 2022] DELETE /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:07:20.436045 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ed841ddc-f43f-4df3-8daf-1fc3950d047f tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da218940>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:20.574773 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ed841ddc-f43f-4df3-8daf-1fc3950d047f tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4" status: 200 len: 344 microversion: 2.1 time: 0.143444 Sep 22 17:07:20.577532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 25/35] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:20 2022] GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:21.548598 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:07:21.549935 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:07:21.551086 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:07:21.552068 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:07:21.552749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:07:21.628225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:21.630746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:21.631803 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:21.635165 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:21.635776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:21.637004 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:21.773273 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Getting quotas for project 70b4f8716fa84e439293149dd10cac82. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:07:21.800752 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Getting quotas for user 3725446c6d5040c7870b056d4bfbeca6 and project 70b4f8716fa84e439293149dd10cac82. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:07:21.829223 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-37e6cd18-0e2a-4c82-85ad-d6b7c5aa1112 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'create', calling method: .version_select at 0x7f51da218af0>, body: {"keypair": {"name": "tempest-keypair-1764573413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLcY0k00BOPOu6lD74eH6vR9q9X6VzyXWQ4ZrRUzLc/7rhvPc3cVFiM+DbFmrvMNZSOJYhLLVIoXT1GNyPmdtAAe9aXUmI7ecjrg9Ug9tiNnYzDfiFRvHwRDHAZmvj+HA=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:21.834580 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:07:21.839900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:07:21.949030 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-37e6cd18-0e2a-4c82-85ad-d6b7c5aa1112 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Getting quotas for project 2abeb0b54520461cb414ea9c0599380f. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:07:21.959311 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-37e6cd18-0e2a-4c82-85ad-d6b7c5aa1112 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Getting quotas for user 624f8fd9a74e48afa2f8b74b090a8dd6 and project 2abeb0b54520461cb414ea9c0599380f. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:07:22.064659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-37e6cd18-0e2a-4c82-85ad-d6b7c5aa1112 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.676550 Sep 22 17:07:22.066787 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2a0de982-755f-49f1-8f3e-d179d3627f67 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.069206 Sep 22 17:07:22.074978 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 11/36] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:07:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 6075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:07:22.075472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 26/37] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:07:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:22.084934 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3e771e0e-92d2-416f-ab21-80a7b1bca890 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da14f670>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:22.090408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2653b38d-36d0-47e2-9306-c4223a8bec58 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:22.100317 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2653b38d-36d0-47e2-9306-c4223a8bec58 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:22.176842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-3e771e0e-92d2-416f-ab21-80a7b1bca890 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] HTTP exception thrown: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3e771e0e-92d2-416f-ab21-80a7b1bca890 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Request method failure captured: Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 HTTP/1.1 Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJY4sARkGGdzEVCwvLbLdOYReq52LnrsUe1x5Dt_oZ1sEP-Lu-pXk065WGqan7kkm7tq5BfPFzxd2ERB9xzgtqXDVg2dMVFN0txRYn1GDpCz92g1l9Hy-Br-qQFwsgH5O4K7fIhttY8fiE_09YF01Kccf7bQ1EhK7P4wB82Q5TWp8ks Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 329d492f457d4bc6bf63ff3eb5971826 Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:07:22.179596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 329d492f457d4bc6bf63ff3eb5971826 Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-VolumesSnapshotsTestJSON-1790464045-project Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: a716e14c35014a728f0dc76675ff6874 Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1790464045-project Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '65a641be-2826-490c-aa0f-997353da25a4'} Sep 22 17:07:22.181043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. (HTTP 404) (Request-ID: req-98503d0c-c436-4b71-9283-040f5328650e) Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:22.181867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:22.183856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 17:07:22.187090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.189174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.192819 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3e771e0e-92d2-416f-ab21-80a7b1bca890 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Returning 404 to user: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:22.193932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3e771e0e-92d2-416f-ab21-80a7b1bca890 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4" status: 404 len: 109 microversion: 2.1 time: 0.124778 Sep 22 17:07:22.198435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 12/38] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:22 2022] GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:07:22.209845 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8b403737-80b9-42df-90aa-ea8b420f7a1c tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da14f940>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:22.334007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-8b403737-80b9-42df-90aa-ea8b420f7a1c tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] HTTP exception thrown: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8b403737-80b9-42df-90aa-ea8b420f7a1c tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Request method failure captured: Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: DELETE /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 HTTP/1.1 Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJY4sARkGGdzEVCwvLbLdOYReq52LnrsUe1x5Dt_oZ1sEP-Lu-pXk065WGqan7kkm7tq5BfPFzxd2ERB9xzgtqXDVg2dMVFN0txRYn1GDpCz92g1l9Hy-Br-qQFwsgH5O4K7fIhttY8fiE_09YF01Kccf7bQ1EhK7P4wB82Q5TWp8ks Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 329d492f457d4bc6bf63ff3eb5971826 Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:07:22.336780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 329d492f457d4bc6bf63ff3eb5971826 Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-VolumesSnapshotsTestJSON-1790464045-project Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: a716e14c35014a728f0dc76675ff6874 Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1790464045-project Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '65a641be-2826-490c-aa0f-997353da25a4'} Sep 22 17:07:22.337893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. (HTTP 404) (Request-ID: req-e7095b50-96d2-4d40-8a74-439f34b3ad91) Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:22.338525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 17:07:22.339455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 17:07:22.340388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.341390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.343914 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8b403737-80b9-42df-90aa-ea8b420f7a1c tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Returning 404 to user: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:22.345233 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8b403737-80b9-42df-90aa-ea8b420f7a1c tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4" status: 404 len: 109 microversion: 2.1 time: 0.140548 Sep 22 17:07:22.346332 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 13/39] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:07:22 2022] DELETE /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:07:22.355241 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e6871b60-4f40-452e-85c1-e9cc15ebf289 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Calling method '.version_select at 0x7f51da2c2820>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:22.422328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-e6871b60-4f40-452e-85c1-e9cc15ebf289 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] HTTP exception thrown: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e6871b60-4f40-452e-85c1-e9cc15ebf289 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Request method failure captured: Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 HTTP/1.1 Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJY4sARkGGdzEVCwvLbLdOYReq52LnrsUe1x5Dt_oZ1sEP-Lu-pXk065WGqan7kkm7tq5BfPFzxd2ERB9xzgtqXDVg2dMVFN0txRYn1GDpCz92g1l9Hy-Br-qQFwsgH5O4K7fIhttY8fiE_09YF01Kccf7bQ1EhK7P4wB82Q5TWp8ks Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 329d492f457d4bc6bf63ff3eb5971826 Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:07:22.434300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_329d492f457d4bc6bf63ff3eb5971826"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 329d492f457d4bc6bf63ff3eb5971826 Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1790464045 Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-VolumesSnapshotsTestJSON-1790464045-project Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: a716e14c35014a728f0dc76675ff6874 Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1790464045-project Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '65a641be-2826-490c-aa0f-997353da25a4'} Sep 22 17:07:22.436115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. (HTTP 404) (Request-ID: req-c72e3549-7e6f-41bb-b064-2b56d6e4ccc6) Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:22.436775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 17:07:22.437690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 17:07:22.438800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. Sep 22 17:07:22.440052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:07:22.441034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2653b38d-36d0-47e2-9306-c4223a8bec58 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:22.443973 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e6871b60-4f40-452e-85c1-e9cc15ebf289 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] Returning 404 to user: Volume 65a641be-2826-490c-aa0f-997353da25a4 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:07:22.445530 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e6871b60-4f40-452e-85c1-e9cc15ebf289 tempest-VolumesSnapshotsTestJSON-1790464045 tempest-VolumesSnapshotsTestJSON-1790464045-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4" status: 404 len: 109 microversion: 2.1 time: 0.094491 Sep 22 17:07:22.447901 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 14/40] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:22 2022] GET /compute/v2.1/os-volumes/65a641be-2826-490c-aa0f-997353da25a4 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:07:22.474162 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2653b38d-36d0-47e2-9306-c4223a8bec58 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1215 microversion: 2.1 time: 0.396637 Sep 22 17:07:22.475768 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 27/41] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:22 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1215 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:23.506225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8ed25790-6974-4e92-8ecf-138e8d34347e tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:23.507594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8ed25790-6974-4e92-8ecf-138e8d34347e tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:24.013776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8ed25790-6974-4e92-8ecf-138e8d34347e tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:24.068952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8ed25790-6974-4e92-8ecf-138e8d34347e tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1215 microversion: 2.1 time: 0.568613 Sep 22 17:07:24.079444 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 15/42] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:23 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1215 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:25.120425 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:25.121870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:25.140759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:25.142864 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:25.144264 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:25.146090 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:25.148199 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:25.148852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:25.849573 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:25.936569 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e0dcea5d-78d9-4d14-9d17-5e274bdc6145 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1219 microversion: 2.1 time: 0.820847 Sep 22 17:07:25.958339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 28/43] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:25 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1219 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:26.984766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:26.987098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:27.019921 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:27.027452 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:27.035335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:27.035335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:27.038324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:27.040803 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:28.072169 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:28.182134 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3f8b5799-38dc-4a7a-b9e5-c4bcb6e8a09d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1275 microversion: 2.1 time: 1.196989 Sep 22 17:07:28.195394 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 16/44] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:26 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1275 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:29.219060 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:29.220201 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:29.242832 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:29.250694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:29.250694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:29.259712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:29.261039 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:29.268409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:29.960127 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a68005c2-c065-480f-a0f2-594a1a0b34d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'create', calling method: .version_select at 0x7f51da0c0820>, body: {"keypair": {"name": "tempest-keypair-738208346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3GXIpO7rqzyTRIHZCMm7t/m7xfBVdJsyzHynXFnG7RIYp8pSZqO5qVm18ce2Sv/7z51KD9h118tQLoTkQcScjzDsbQrCRko+MttGoLVCIZhN1ZZAnpq4BXsvRub5buLQ=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:30.018489 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:30.064817 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cae49df4-3e9d-45c9-a36e-0fbb181a61d2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1273 microversion: 2.1 time: 0.845755 Sep 22 17:07:30.065825 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 17/45] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:29 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1273 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:30.075625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-a68005c2-c065-480f-a0f2-594a1a0b34d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Getting quotas for project 45847b1fd67c4caaa03a36895cd2263a. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:07:30.098643 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-a68005c2-c065-480f-a0f2-594a1a0b34d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Getting quotas for user b34e9318826c49ed891dde1f7782898b and project 45847b1fd67c4caaa03a36895cd2263a. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:07:30.186185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a68005c2-c065-480f-a0f2-594a1a0b34d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.019994 Sep 22 17:07:30.192453 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 29/46] 10.222.0.16 () {62 vars in 1200 bytes} [Thu Sep 22 17:07:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1027 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 22 17:07:31.102275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:31.103039 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:31.131488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:31.139057 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:31.144047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:31.145221 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:31.145971 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:31.148965 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:31.710597 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:31.786769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:31.811614 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-237d79b6-d567-4355-8fa0-55d7ee5794ab tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1273 microversion: 2.1 time: 0.714261 Sep 22 17:07:31.840558 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 18/47] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:31 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1273 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:32.734916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-581814662", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:32.892813 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:32.893955 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:32.957097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:32.958192 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:32.983311 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:32.984498 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:32.989181 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:32.990024 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:33.277552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] validate_networks() for [('906da010-9d01-428f-8bbf-d862e44df893', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:07:34.070518 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=8 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:34.210526 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:34.278110 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2af00590-bc6d-4cf5-b4c0-6acb07c55dc9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1273 microversion: 2.1 time: 1.393446 Sep 22 17:07:34.283712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 19/48] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:32 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1273 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:34.439589 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-319800191", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ade9c12a-c9b5-416e-9a3a-173c84f0a9ae"}], "security_groups": [{"name": "tempest-securitygroup--1719257123"}], "key_name": "tempest-keypair-1764573413", "user_data": "}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:35.907662 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:36.270473 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] validate_networks() for [('ade9c12a-c9b5-416e-9a3a-173c84f0a9ae', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:07:38.802851 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:07:38.804420 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:07:38.805610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:07:38.806242 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:07:38.806880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:07:38.830718 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:38.831617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:38.832313 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:38.833360 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:38.839307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:38.840310 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:38.900191 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Getting quotas for project 2abeb0b54520461cb414ea9c0599380f. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:07:38.908570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Getting quotas for user 624f8fd9a74e48afa2f8b74b090a8dd6 and project 2abeb0b54520461cb414ea9c0599380f. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:07:38.947449 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:07:38.960059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:07:39.121004 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-46adadd0-ac1d-45e9-a627-a5e8a0cc6d44 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.694561 Sep 22 17:07:39.123980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 20/49] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:07:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 4699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:07:39.133675 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:39.162118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:39.178330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:39.178831 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:39.181563 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:39.193280 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:39.194588 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:39.195437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:39.851322 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:07:39.852157 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:07:39.853564 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:07:39.855063 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:07:39.858594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:07:39.908620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:39.912535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:39.913248 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:39.914267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:39.915786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:39.918645 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:39.996693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Getting quotas for project 105c11557b6f45329dc97af01e8ea915. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:07:40.014920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Getting quotas for user bc8c2a5413c943ed94d76eceb2720f17 and project 105c11557b6f45329dc97af01e8ea915. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:07:40.050866 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:07:40.060847 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:07:40.342664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3925409e-da00-462d-a2cf-2bfac520da95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.241956 Sep 22 17:07:40.347065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 30/50] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:07:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 8255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:07:40.374919 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-95ba6182-eeca-4b9c-abfd-59a402af354e tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51d9fe6c10>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:40.617492 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-95ba6182-eeca-4b9c-abfd-59a402af354e tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/204eb533-d52e-4f9f-aa2b-4d4b9d57fe6b" status: 200 len: 350 microversion: 2.1 time: 0.259318 Sep 22 17:07:40.618179 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 31/51] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:40 2022] GET /compute/v2.1/os-volumes/204eb533-d52e-4f9f-aa2b-4d4b9d57fe6b => generated 350 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:41.440307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:41.456190 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c3c616fe-0273-42bc-a3e9-03890e124334 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 2.327497 Sep 22 17:07:41.461252 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 21/52] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:39 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:41.487601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:41.492103 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:41.526508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:41.529330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:41.532552 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:41.540196 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:41.540950 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:41.544824 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:41.843979 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f8d9a0b6-2585-411b-ac07-a19b6fb38df2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: .version_select at 0x7f51da002310>, body: {"keypair": {"name": "tempest-keypair-1680058556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8EWNtLJu8xK9wE/Mk7WDBSnQR1/H62CfMeLPitN0PCZrIBRK0s6pHa3pxtLPobe3gc4JWwvG5oK8piBUdaOxqExyaIV2OJY4+uRdXhmeFqY3Asru08+cMHN5WI8p3PRg=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:41.954621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-f8d9a0b6-2585-411b-ac07-a19b6fb38df2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:07:42.037287 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-f8d9a0b6-2585-411b-ac07-a19b6fb38df2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for user 5feea3b3b7e4401ea7db242cb60fdfcc and project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:07:42.207242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f8d9a0b6-2585-411b-ac07-a19b6fb38df2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.570427 Sep 22 17:07:42.211944 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 32/53] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:07:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:42.236451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6da25590-d5d9-4843-b0a1-35a7baee0680 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:42.247864 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6da25590-d5d9-4843-b0a1-35a7baee0680 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:42.636501 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:42.650188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ae7bb5c7-07ed-4b17-8044-077baf702ac1 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1241 microversion: 2.1 time: 1.184139 Sep 22 17:07:42.662147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 22/54] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:41 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1241 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:42.781128 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6da25590-d5d9-4843-b0a1-35a7baee0680 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:42.789981 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6da25590-d5d9-4843-b0a1-35a7baee0680 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1221 microversion: 2.1 time: 0.575093 Sep 22 17:07:42.798746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 33/55] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:42 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1221 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:42.832033 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:42.832687 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:42.883340 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:42.884443 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:42.884443 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:42.885220 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:42.895942 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:42.898664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:43.273518 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-8bc309a6-b1d5-4084-ae9a-eeb83a847b8e req-baa9d489-983e-4655-a6d6-bb6173cd42a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed59422-e086-4f95-b56c-8dbe57faed78", "tag": "4f54a4b6-ee55-4522-8820-9778a712cff0"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:43.365158 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-8bc309a6-b1d5-4084-ae9a-eeb83a847b8e req-baa9d489-983e-4655-a6d6-bb6173cd42a9 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:43.368073 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-8bc309a6-b1d5-4084-ae9a-eeb83a847b8e req-baa9d489-983e-4655-a6d6-bb6173cd42a9 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:43.368800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-8bc309a6-b1d5-4084-ae9a-eeb83a847b8e req-baa9d489-983e-4655-a6d6-bb6173cd42a9 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:43.451786 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-8bc309a6-b1d5-4084-ae9a-eeb83a847b8e req-baa9d489-983e-4655-a6d6-bb6173cd42a9 service nova] Creating event network-changed:4f54a4b6-ee55-4522-8820-9778a712cff0 for instance 6ed59422-e086-4f95-b56c-8dbe57faed78 on hv-cinder-83538 Sep 22 17:07:43.452391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-8bc309a6-b1d5-4084-ae9a-eeb83a847b8e req-baa9d489-983e-4655-a6d6-bb6173cd42a9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120804) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 22 17:07:43.453281 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-8bc309a6-b1d5-4084-ae9a-eeb83a847b8e req-baa9d489-983e-4655-a6d6-bb6173cd42a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120804) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 22 17:07:43.454717 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f09db029-8085-4394-99c8-b655812c3c17 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:43.455429 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f09db029-8085-4394-99c8-b655812c3c17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:43.456061 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f09db029-8085-4394-99c8-b655812c3c17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:43.457325 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f09db029-8085-4394-99c8-b655812c3c17 None None] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:43.458040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f09db029-8085-4394-99c8-b655812c3c17 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:43.459288 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f09db029-8085-4394-99c8-b655812c3c17 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:43.475269 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.compute.rpcapi [None req-f09db029-8085-4394-99c8-b655812c3c17 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 22 17:07:43.476872 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f09db029-8085-4394-99c8-b655812c3c17 None None] Releasing lock "compute-rpcapi-router" {{(pid=120804) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 22 17:07:43.520634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f09db029-8085-4394-99c8-b655812c3c17 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.855009 Sep 22 17:07:43.525505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 23/56] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:43.539745 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-abd7297f-7215-45b9-aca6-69353c5f1d7a tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51d97e74c0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:43.791539 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-abd7297f-7215-45b9-aca6-69353c5f1d7a tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/672d372c-7a5a-4cd9-883f-5d067f139f2c" status: 200 len: 350 microversion: 2.1 time: 0.262126 Sep 22 17:07:43.792188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 24/57] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:43 2022] GET /compute/v2.1/os-volumes/672d372c-7a5a-4cd9-883f-5d067f139f2c => generated 350 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:43.806595 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:43.807422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:43.838111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:43.838666 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:43.839163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:43.839891 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:43.840351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:43.851308 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:44.757424 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:44.779357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=49 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:44.798642 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9f75a543-22b1-403b-9503-eb5bdf6b617f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1289 microversion: 2.1 time: 0.995619 Sep 22 17:07:44.827285 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 25/58] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:43 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1289 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:44.852393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-225630223", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:44.911261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:45.077877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:45.092922 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] validate_networks() for [('906da010-9d01-428f-8bbf-d862e44df893', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:07:45.126798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-36b3ac6d-4b38-4bad-82d7-e2d95e630318 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 2.320924 Sep 22 17:07:45.127557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 34/59] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:42 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:45.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:45.839751 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:45.865281 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:45.886150 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:45.893456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:45.895080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:45.897698 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:45.906460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:45.911688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:46.568132 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:46.611233 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0a1b4e01-121b-4fd1-9d6d-cb30e22b574b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1295 microversion: 2.1 time: 0.780241 Sep 22 17:07:46.629543 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 35/60] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:45 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1295 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:07:46.662335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:46.672557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:46.744780 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:46.757388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:46.760436 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:46.765904 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:46.775336 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:46.786467 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:48.134708 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:48.185136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-341b8dd6-bb05-457f-b974-4a50ed965240 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 1.547000 Sep 22 17:07:48.186051 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 36/61] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:46 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:48.261656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fe896f8e-a108-4541-85db-b29c1cb8a9b0 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51da012dc0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:48.506210 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fe896f8e-a108-4541-85db-b29c1cb8a9b0 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5167f0ce-2071-4453-b4a5-bf8849cb9cf9" status: 200 len: 351 microversion: 2.1 time: 0.294850 Sep 22 17:07:48.516399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 37/62] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 22 17:07:48 2022] GET /compute/v2.1/os-volumes/5167f0ce-2071-4453-b4a5-bf8849cb9cf9 => generated 351 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:48.517653 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:07:48.519982 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:07:48.521607 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:07:48.522367 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1542527718", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb742a8a-ec14-42fa-b5c3-8fe1992e342c"}], "security_groups": [{"name": "tempest-securitygroup--1894033301"}], "key_name": "tempest-keypair-738208346", "user_data": "}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:48.523093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:07:48.524251 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:07:48.609355 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:48.609766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:48.612266 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:48.616933 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:48.617395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:48.617835 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:48.697623 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Getting quotas for project 105c11557b6f45329dc97af01e8ea915. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:07:48.714692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Getting quotas for user bc8c2a5413c943ed94d76eceb2720f17 and project 105c11557b6f45329dc97af01e8ea915. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:07:48.753599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:07:48.758248 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:07:48.897173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-35471c8a-28cd-4481-801e-949d83db65e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.068433 Sep 22 17:07:48.898075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 26/63] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:07:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 4070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:07:48.903922 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:48.914369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:48.931370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:48.932249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:48.937096 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:48.938106 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:48.938740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:48.939361 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:49.297025 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:49.331121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b841a4df-a726-4e3e-b8df-1de105c6ec14 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1295 microversion: 2.1 time: 0.431671 Sep 22 17:07:49.332079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 27/64] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:48 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1295 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:49.347764 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-67b35a2c-69da-40ae-a7c4-b5ed18434621 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51d97e7a60>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:49.592585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] validate_networks() for [('fb742a8a-ec14-42fa-b5c3-8fe1992e342c', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:07:49.857893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-67b35a2c-69da-40ae-a7c4-b5ed18434621 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.524379 Sep 22 17:07:49.859195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 28/65] 10.222.0.16 () {58 vars in 1134 bytes} [Thu Sep 22 17:07:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:49.864670 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2b49a3c0-cd46-477a-bf90-a7058939d3c9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:49.865834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2b49a3c0-cd46-477a-bf90-a7058939d3c9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:49.962784 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:50.548800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2b49a3c0-cd46-477a-bf90-a7058939d3c9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:50.563525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2b49a3c0-cd46-477a-bf90-a7058939d3c9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1221 microversion: 2.1 time: 0.702906 Sep 22 17:07:50.564500 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 29/66] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:49 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1221 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:50.569265 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:50.577013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:50.598619 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:50.599163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:50.599610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:50.600339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:50.600806 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:50.601226 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:50.982446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:50.990357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bf681b3d-720a-4f8d-887c-383fd44e708d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 0.424671 Sep 22 17:07:50.996137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 30/67] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:50 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:51.006727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-28b7a398-ab2d-44bf-bbff-0cb8d0a55a58 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51d97d6280>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:51.346107 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-28b7a398-ab2d-44bf-bbff-0cb8d0a55a58 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.347548 Sep 22 17:07:51.347174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 31/68] 10.222.0.16 () {58 vars in 1149 bytes} [Thu Sep 22 17:07:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:51.365928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:51.373389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:51.395035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:51.395538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:51.395977 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:51.396696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:51.397153 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:51.397582 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:51.586395 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:07:51.587012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:07:51.587342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:07:51.587760 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:07:51.588180 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:07:51.601068 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=23 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:07:51.610461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:51.610973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:51.612078 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:51.612274 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:51.612774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:51.613386 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:51.667375 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Getting quotas for project 45847b1fd67c4caaa03a36895cd2263a. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:07:51.675130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Getting quotas for user b34e9318826c49ed891dde1f7782898b and project 45847b1fd67c4caaa03a36895cd2263a. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:07:51.709789 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:07:51.712341 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:07:51.817116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:51.826214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a8be1c16-9092-414f-968c-75817b510f98 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.476717 Sep 22 17:07:51.827323 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 32/69] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:51 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:51.828010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9816850e-774e-43d8-ab3c-4899963b3fa6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.302767 Sep 22 17:07:51.831633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 38/70] 10.222.0.16 () {62 vars in 1188 bytes} [Thu Sep 22 17:07:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3323 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 22 17:07:51.839882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:51.840811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:51.851060 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-18d6525d-74b3-4395-a34d-2be1759095ab tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51da0123a0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:51.870636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:51.874437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:51.875209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:51.876126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:51.880213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:51.883330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:51.997870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:52.006085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6246d558-6757-4427-befd-5a72f71ff205 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1217 microversion: 2.1 time: 0.170034 Sep 22 17:07:52.006684 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 33/71] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:51 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:52.018914 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-56acb605-4e8c-486c-b133-92f23fca30ee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:52.022783 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-56acb605-4e8c-486c-b133-92f23fca30ee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:52.234532 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-56acb605-4e8c-486c-b133-92f23fca30ee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:52.242671 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-18d6525d-74b3-4395-a34d-2be1759095ab tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.409604 Sep 22 17:07:52.243766 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 39/72] 10.222.0.16 () {58 vars in 1134 bytes} [Thu Sep 22 17:07:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:52.245973 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-56acb605-4e8c-486c-b133-92f23fca30ee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:52.248421 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-56acb605-4e8c-486c-b133-92f23fca30ee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:52.249751 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-56acb605-4e8c-486c-b133-92f23fca30ee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1281 microversion: 2.20 time: 0.237413 Sep 22 17:07:52.250423 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 34/73] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:07:52 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:07:52.257004 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:52.259017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:52.270044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-97276dc6-9986-41e4-864d-e080e1d51a4d tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51d97e7af0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:52.287696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:52.298295 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:52.299134 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:52.300127 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:52.302209 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:52.303111 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:52.552054 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-97276dc6-9986-41e4-864d-e080e1d51a4d tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.285011 Sep 22 17:07:52.556247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 35/74] 10.222.0.16 () {58 vars in 1167 bytes} [Thu Sep 22 17:07:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:52.626289 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d2af2715-b495-4e1c-9dc1-196317993c2b tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51d97b65e0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:52.758289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:52.797769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1498480c-bb8f-4362-9a98-974335115ab9 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 0.552425 Sep 22 17:07:52.817920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 40/75] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:52 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:52.862659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:52.865772 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:52.891608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:52.894750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:52.895667 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:52.902130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:52.903721 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:52.906904 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:52.935181 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d2af2715-b495-4e1c-9dc1-196317993c2b tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.351820 Sep 22 17:07:52.967891 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 36/76] 10.222.0.16 () {58 vars in 1170 bytes} [Thu Sep 22 17:07:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:52.974762 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1471591476", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82eac7a2-877a-48c4-bcb2-cd10274854a5"}], "security_groups": [{"name": "tempest-securitygroup--646853484"}], "key_name": "tempest-keypair-1680058556", "user_data": "}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:53.221504 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] validate_networks() for [('82eac7a2-877a-48c4-bcb2-cd10274854a5', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:07:53.227720 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:53.238312 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7ef541ed-8aca-47fb-95ea-b098cddca748 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.386064 Sep 22 17:07:53.238918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 41/77] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:52 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:53.254244 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ce5b467a-cf17-420d-8fda-ec42239d8a88 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51d97c1790>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:53.442449 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ce5b467a-cf17-420d-8fda-ec42239d8a88 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.202413 Sep 22 17:07:53.443439 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 42/78] 10.222.0.16 () {58 vars in 1155 bytes} [Thu Sep 22 17:07:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:53.459268 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:53.460466 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:53.468264 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:53.469216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:53.469803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:53.470769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:53.471414 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:53.471990 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:53.568429 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:53.593696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5d6b9b14-1305-4b2e-8d23-4fdbee95bf2c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1217 microversion: 2.1 time: 0.148608 Sep 22 17:07:53.595565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 43/79] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:53 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:53.605352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:53.606403 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:53.614279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:53.614887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:53.615470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:53.616190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:53.616722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:53.617090 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:53.900565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:53.947907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:53.953581 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:53.962376 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7dc30572-e086-4fdd-bb40-4ebad3db4148 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1285 microversion: 2.20 time: 0.359200 Sep 22 17:07:53.963926 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 44/80] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:07:53 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1285 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:07:53.977278 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-645efb4a-aa96-4f86-abbb-83e8835142f2 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51da0120d0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:54.256213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-645efb4a-aa96-4f86-abbb-83e8835142f2 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.290663 Sep 22 17:07:54.256789 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 45/81] 10.222.0.16 () {58 vars in 1188 bytes} [Thu Sep 22 17:07:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:54.262883 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:54.263790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:54.289015 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:54.289818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:54.290714 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:54.294299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:54.295098 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:54.297908 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:55.597863 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:07:55.598462 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:07:55.598981 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:07:55.609689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:07:55.610158 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:07:55.614083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:55.633330 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4590783c-fb85-4511-a350-beaf0eddbaef tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 1.370684 Sep 22 17:07:55.634884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 46/82] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:54 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:55.641793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:55.642345 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:55.643058 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:55.643970 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:55.644433 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:55.644863 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:55.646814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c375e985-2f44-473c-8de4-c1a1e75f8137 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] Calling method '.version_select at 0x7f51d97a99d0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:55.700488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:07:55.712886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for user 5feea3b3b7e4401ea7db242cb60fdfcc and project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:07:55.764244 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:07:55.769952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:07:55.988827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-259b6572-8075-46cf-abb0-e635443cbabb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.018228 Sep 22 17:07:55.995077 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 37/83] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:07:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 3023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:07:56.000545 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:56.006020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:56.021143 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:56.026419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:56.027113 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:56.028583 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:56.029216 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:56.030576 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:56.118994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c375e985-2f44-473c-8de4-c1a1e75f8137 tempest-VolumesTestJSON-457759952 tempest-VolumesTestJSON-457759952-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.482362 Sep 22 17:07:56.120061 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 47/84] 10.222.0.16 () {58 vars in 1155 bytes} [Thu Sep 22 17:07:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:56.127358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:56.128224 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:56.149550 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:56.149892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:56.154227 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:56.154834 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:56.161434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:56.162140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:56.438535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:56.468583 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-724c2fc3-7252-4bd1-a68a-e2a35f421ece tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1279 microversion: 2.1 time: 0.343868 Sep 22 17:07:56.477251 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 48/85] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:56 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1279 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:56.530903 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:56.532900 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:56.554790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:56.555345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:56.555776 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:56.556493 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:56.556945 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:56.557365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:56.741928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:56.786534 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-06887861-3c68-417d-9593-4a7e0e1b9892 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.788544 Sep 22 17:07:56.804347 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 38/86] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:55 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:56.821305 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a7824713-2469-45a8-bee8-fdaf96e8a913 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:56.824961 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a7824713-2469-45a8-bee8-fdaf96e8a913 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:57.030211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:57.064872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:57.076378 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:57.084396 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3d42830e-a6b5-4c05-b340-3d894dc74e71 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1351 microversion: 2.20 time: 0.601878 Sep 22 17:07:57.105495 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 49/87] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:07:56 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1351 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:07:57.170721 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-eba938c2-14fd-492b-8967-b531e23f099c req-de52af02-d272-4d78-95a3-e2cb7de45982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979379b2-1673-4425-be3f-98d99729db47", "tag": "e62c689f-694f-4650-961c-8b16b6ed4e18"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:57.210486 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a7824713-2469-45a8-bee8-fdaf96e8a913 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:57.221742 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a7824713-2469-45a8-bee8-fdaf96e8a913 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1242 microversion: 2.1 time: 0.411059 Sep 22 17:07:57.222627 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 39/88] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:56 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1242 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:57.235891 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:57.236873 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:57.238493 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-eba938c2-14fd-492b-8967-b531e23f099c req-de52af02-d272-4d78-95a3-e2cb7de45982 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:57.240560 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-eba938c2-14fd-492b-8967-b531e23f099c req-de52af02-d272-4d78-95a3-e2cb7de45982 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:57.241592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-eba938c2-14fd-492b-8967-b531e23f099c req-de52af02-d272-4d78-95a3-e2cb7de45982 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:57.254729 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:57.256261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:57.257529 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:57.259525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:57.260231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:57.263656 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:57.345446 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-eba938c2-14fd-492b-8967-b531e23f099c req-de52af02-d272-4d78-95a3-e2cb7de45982 service nova] Creating event network-changed:e62c689f-694f-4650-961c-8b16b6ed4e18 for instance 979379b2-1673-4425-be3f-98d99729db47 on hv-cinder-83538 Sep 22 17:07:57.346233 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-eba938c2-14fd-492b-8967-b531e23f099c req-de52af02-d272-4d78-95a3-e2cb7de45982 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120805) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 22 17:07:57.346772 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-eba938c2-14fd-492b-8967-b531e23f099c req-de52af02-d272-4d78-95a3-e2cb7de45982 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120805) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 22 17:07:57.348785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c40ed88-1451-4411-950b-d4bf402aa8e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:57.349438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c40ed88-1451-4411-950b-d4bf402aa8e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:57.350825 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c40ed88-1451-4411-950b-d4bf402aa8e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:57.351696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c40ed88-1451-4411-950b-d4bf402aa8e6 None None] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:57.352145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c40ed88-1451-4411-950b-d4bf402aa8e6 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:57.352559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c40ed88-1451-4411-950b-d4bf402aa8e6 None None] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:57.378565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.compute.rpcapi [None req-4c40ed88-1451-4411-950b-d4bf402aa8e6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 22 17:07:57.379716 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4c40ed88-1451-4411-950b-d4bf402aa8e6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120805) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 22 17:07:57.400973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4c40ed88-1451-4411-950b-d4bf402aa8e6 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275549 Sep 22 17:07:57.405724 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 50/89] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:57.505128 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:57.506153 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:57.527756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:57.532323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:57.534470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:57.535736 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:57.549978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:57.551493 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:58.132478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:58.141695 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8498b9ff-fe4c-4eeb-b861-31549b508ea8 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 0.917701 Sep 22 17:07:58.142300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 40/90] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:57 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:58.154786 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:58.162078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:58.172028 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:58.175172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:58.177160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:58.182317 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:58.185443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:58.186291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:58.228038 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:58.240033 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-75365147-1586-438f-a693-376a7abe4f0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1279 microversion: 2.1 time: 0.743144 Sep 22 17:07:58.255631 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 51/91] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:57 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1279 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:07:58.506145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:58.521374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ac950ce0-47ab-4686-b29c-63c8be0b4c27 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.368172 Sep 22 17:07:58.522039 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 41/92] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:58 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:58.558379 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:58.559117 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:58.579783 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:58.585768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:58.587651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:58.588404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:58.588911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:58.589467 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:58.762361 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:58.774251 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:58.787588 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:58.788796 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5924e5af-e3dc-4a99-81c5-9fc6b8421a42 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1339 microversion: 2.20 time: 0.246934 Sep 22 17:07:58.798406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 42/93] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:07:58 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1339 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:07:58.818970 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:58.820103 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:58.827795 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:58.832339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:58.836996 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:58.838011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:58.838515 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:58.842770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:58.871078 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-eff07b02-5b1d-4c5a-9918-e17df397c2ed req-3d8d2449-498d-4b59-be6a-f8eeb13be6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7947f62-c48e-4f60-b109-295247f6e1aa", "tag": "d0d3ad94-b2b0-4603-b33c-ae0e3280fa0c"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:07:58.894027 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-eff07b02-5b1d-4c5a-9918-e17df397c2ed req-3d8d2449-498d-4b59-be6a-f8eeb13be6a5 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:58.903738 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-eff07b02-5b1d-4c5a-9918-e17df397c2ed req-3d8d2449-498d-4b59-be6a-f8eeb13be6a5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:58.904495 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-eff07b02-5b1d-4c5a-9918-e17df397c2ed req-3d8d2449-498d-4b59-be6a-f8eeb13be6a5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:58.942128 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-eff07b02-5b1d-4c5a-9918-e17df397c2ed req-3d8d2449-498d-4b59-be6a-f8eeb13be6a5 service nova] Creating event network-changed:d0d3ad94-b2b0-4603-b33c-ae0e3280fa0c for instance b7947f62-c48e-4f60-b109-295247f6e1aa on hv-cinder-83538 Sep 22 17:07:58.956450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-eff07b02-5b1d-4c5a-9918-e17df397c2ed req-3d8d2449-498d-4b59-be6a-f8eeb13be6a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.690728 Sep 22 17:07:58.957530 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 52/94] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:07:58.991351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:59.001857 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-48630542-8f64-4562-a20c-8214c7ab8afe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1302 microversion: 2.1 time: 0.201213 Sep 22 17:07:59.003064 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 43/95] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:58 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1302 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:59.166900 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:59.167830 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:59.184687 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:59.186784 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:59.188617 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:59.191895 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:59.193014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:59.197330 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:59.278657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:59.279749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:59.294636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:59.296722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:59.299928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:59.303651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:59.305127 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:59.308007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:59.631546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:59.641009 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ca088f98-43fa-40d3-981d-1ceadc0f8579 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 0.478767 Sep 22 17:07:59.655321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 53/96] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:59 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:07:59.656128 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:07:59.656315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:59.656315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:59.667279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:59.667279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:59.667279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:59.667279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:59.668903 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:59.668903 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:59.678672 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fffe6de1-fc14-49f4-8b42-b4f3f2029179 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.404642 Sep 22 17:07:59.680965 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 44/97] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:59 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:07:59.836700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:07:59.838263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:07:59.849006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:59.851052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:59.851782 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:07:59.852786 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:07:59.853479 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:07:59.854127 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:00.217534 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:00.245851 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7925215b-03a9-4817-b6b5-fe157da28a8f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.603235 Sep 22 17:08:00.256192 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 54/98] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:07:59 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:00.266306 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:00.270122 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:00.287620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:00.288312 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:00.288937 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:00.289840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:00.290470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:00.291943 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:00.325192 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:00.334258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:00.345532 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:00.346876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-04f1ffaf-3a50-4b3a-8f74-a9e3a9d7ef0f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.521240 Sep 22 17:08:00.347520 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 45/99] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:07:59 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:08:00.430493 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:00.440750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6d6da957-109e-40d5-b7fc-48ed1da8ccee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1302 microversion: 2.1 time: 0.181875 Sep 22 17:08:00.441371 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 55/100] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:00 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1302 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:00.716058 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:00.723696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:00.724870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:00.727838 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:00.741768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:00.743026 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:00.743928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:00.744814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:00.745009 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:00.746173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:00.748307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:00.749468 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:00.750582 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:00.750795 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:00.751685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:00.752771 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:01.577755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:01.585640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:01.600793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-50273955-4c1f-4359-98ec-9d0a2fbe3d3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.882113 Sep 22 17:08:01.603008 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 56/101] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:00 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:01.622412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:01.636215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-edc18e3d-cc15-4627-b83d-a31e87e5194d tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 0.924021 Sep 22 17:08:01.642182 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 46/102] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:00 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:01.653657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:01.655940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:01.671857 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:01.672564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:01.673106 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:01.675560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:01.676360 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:01.678521 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:01.696683 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=5 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:01.878409 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-ba8b9ed6-1796-4b33-ac4d-8e9366269d00 req-d7a5a801-292a-4175-9cbc-571566929d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed59422-e086-4f95-b56c-8dbe57faed78", "name": "network-vif-plugged", "status": "completed", "tag": "4f54a4b6-ee55-4522-8820-9778a712cff0"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:01.889100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-ba8b9ed6-1796-4b33-ac4d-8e9366269d00 req-d7a5a801-292a-4175-9cbc-571566929d5f service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:01.889849 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-ba8b9ed6-1796-4b33-ac4d-8e9366269d00 req-d7a5a801-292a-4175-9cbc-571566929d5f service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:01.890310 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-ba8b9ed6-1796-4b33-ac4d-8e9366269d00 req-d7a5a801-292a-4175-9cbc-571566929d5f service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:01.906285 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-ba8b9ed6-1796-4b33-ac4d-8e9366269d00 req-d7a5a801-292a-4175-9cbc-571566929d5f service nova] Creating event network-vif-plugged:4f54a4b6-ee55-4522-8820-9778a712cff0 for instance 6ed59422-e086-4f95-b56c-8dbe57faed78 on hv-cinder-83538 Sep 22 17:08:01.932626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-ba8b9ed6-1796-4b33-ac4d-8e9366269d00 req-d7a5a801-292a-4175-9cbc-571566929d5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326695 Sep 22 17:08:01.941802 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 57/103] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:01.950404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:01.951563 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:01.958756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:01.959643 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:01.960442 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:01.961368 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:01.962729 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:01.963512 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:02.336306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:02.365028 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b2dd4ca6-b647-42f5-a326-d10d9d79b412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.720082 Sep 22 17:08:02.366338 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 47/104] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:01 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:02.390781 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:02.392992 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:02.405961 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:02.406735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:02.407383 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:02.409093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:02.410005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:02.410725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:02.542023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:02.549333 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:02.559236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b0c306bd-7550-4812-ab44-1128ede1ef58 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1300 microversion: 2.1 time: 0.188580 Sep 22 17:08:02.564032 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:02.573697 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:02.576805 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-eef995c7-9b2c-4f57-9a5b-e4da4530c3ea tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.632710 Sep 22 17:08:02.577568 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 48/105] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:02 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:02.580228 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 58/106] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:01 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:02.628645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:02.629401 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:02.642277 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:02.643770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:02.644412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:02.645525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:02.650585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:02.651223 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:02.662545 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:02.663603 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:02.674402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:02.676299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:02.677459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:02.678905 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:02.680074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:02.681952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:03.236316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:03.248337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-97e568a4-ab13-4893-afe1-4d9e4234c5ff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.624155 Sep 22 17:08:03.267759 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 49/107] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:02 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:03.294653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:03.314484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4b7f6527-c2cf-4f4f-a683-58de581af790 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 0.656194 Sep 22 17:08:03.332573 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 59/108] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:02 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:03.386118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-38fda220-42ce-4f81-b011-6561148ad19b req-f854b9a7-ab88-495b-ae62-97e1360e8a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb35797-a6cf-42af-9274-a2d6aadd2643", "tag": "fd0e7b8c-420d-4637-a290-d9a8014bf255"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:03.401113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:03.402731 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:03.447853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:03.448026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-38fda220-42ce-4f81-b011-6561148ad19b req-f854b9a7-ab88-495b-ae62-97e1360e8a10 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:03.448185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:03.448185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:03.448463 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-38fda220-42ce-4f81-b011-6561148ad19b req-f854b9a7-ab88-495b-ae62-97e1360e8a10 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:03.448625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:03.448767 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-38fda220-42ce-4f81-b011-6561148ad19b req-f854b9a7-ab88-495b-ae62-97e1360e8a10 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:03.448918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:03.456743 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:03.491560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-38fda220-42ce-4f81-b011-6561148ad19b req-f854b9a7-ab88-495b-ae62-97e1360e8a10 service nova] Creating event network-changed:fd0e7b8c-420d-4637-a290-d9a8014bf255 for instance cdb35797-a6cf-42af-9274-a2d6aadd2643 on hv-cinder-83538 Sep 22 17:08:03.505173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-38fda220-42ce-4f81-b011-6561148ad19b req-f854b9a7-ab88-495b-ae62-97e1360e8a10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122261 Sep 22 17:08:03.506012 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 50/109] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:03.590277 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:03.590703 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:03.613638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:03.615946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:03.619084 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:03.622207 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:03.628967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:03.628967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:03.672677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:03.892259 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:03.900924 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0b560a52-15fc-4b37-a997-acb6f04b2fe4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.507027 Sep 22 17:08:03.915351 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 60/110] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:03 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:03.923754 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:03.925857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:03.940553 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:03.941360 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:03.941981 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:03.942906 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:03.943744 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:03.944385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:04.047937 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:04.057911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-01262b9f-cf9a-4aab-8327-46d9eea307bc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.474363 Sep 22 17:08:04.059307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 51/111] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:03 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:04.193011 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:04.206129 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:04.208394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:04.210264 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-99473201-8888-406d-babd-87cfde81c848 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.293413 Sep 22 17:08:04.211596 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 61/112] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:03 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:04.285728 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:04.286357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:04.304402 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:04.304954 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:04.305366 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:04.306103 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:04.312196 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:04.312946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:04.362232 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:04.362864 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:04.373562 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:04.374585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:04.376434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:04.379232 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:04.383215 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:04.389908 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:05.496842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:05.512201 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e22a3124-0b6e-4e76-860d-eaf586cf1f9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 1.231723 Sep 22 17:08:05.517171 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 52/113] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:04 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:05.526768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:05.530430 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:05.546290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:05.548493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:05.548967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:05.551626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:05.552106 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:05.552535 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:05.602616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:05.617389 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-35448021-5619-4200-ae1e-7f93d458ec41 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 1.259698 Sep 22 17:08:05.630994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 62/114] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:04 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:05.630994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-d2f173e7-68b2-455d-a1b7-5b10d7d3aed5 req-9457eee1-a5f4-42b8-8a45-fcbf9f9a62b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979379b2-1673-4425-be3f-98d99729db47", "name": "network-vif-plugged", "status": "completed", "tag": "e62c689f-694f-4650-961c-8b16b6ed4e18"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:05.670035 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-d2f173e7-68b2-455d-a1b7-5b10d7d3aed5 req-9457eee1-a5f4-42b8-8a45-fcbf9f9a62b3 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:05.670915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-d2f173e7-68b2-455d-a1b7-5b10d7d3aed5 req-9457eee1-a5f4-42b8-8a45-fcbf9f9a62b3 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:05.671616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-d2f173e7-68b2-455d-a1b7-5b10d7d3aed5 req-9457eee1-a5f4-42b8-8a45-fcbf9f9a62b3 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:05.694221 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=8 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:05.706406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-d2f173e7-68b2-455d-a1b7-5b10d7d3aed5 req-9457eee1-a5f4-42b8-8a45-fcbf9f9a62b3 service nova] Creating event network-vif-plugged:e62c689f-694f-4650-961c-8b16b6ed4e18 for instance 979379b2-1673-4425-be3f-98d99729db47 on hv-cinder-83538 Sep 22 17:08:05.725377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-d2f173e7-68b2-455d-a1b7-5b10d7d3aed5 req-9457eee1-a5f4-42b8-8a45-fcbf9f9a62b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100855 Sep 22 17:08:05.726415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 63/115] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:05.740542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:05.741386 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:05.757028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:05.757680 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:05.772446 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:05.773255 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:05.773730 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:05.774175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:06.254628 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:06.263592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bac45b55-1c46-496f-b9ad-caafa2de1d5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.535980 Sep 22 17:08:06.264185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 64/116] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:05 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:06.284050 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:06.285370 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:06.299564 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:06.301092 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:06.302342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:06.303921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:06.305194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:06.306427 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:06.838006 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:06.852561 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:06.855060 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:06.857346 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cb840cfa-7a21-4850-9b94-539989d15e21 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.591758 Sep 22 17:08:06.858790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 65/117] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:06 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:06.867743 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-824f31cc-f5ee-4014-8dfc-826f389f1b9a req-bc800daf-0753-4a70-95b2-ff50341d92e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2", "tag": "9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:06.882586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-824f31cc-f5ee-4014-8dfc-826f389f1b9a req-bc800daf-0753-4a70-95b2-ff50341d92e6 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:06.883659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-824f31cc-f5ee-4014-8dfc-826f389f1b9a req-bc800daf-0753-4a70-95b2-ff50341d92e6 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:06.884870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-824f31cc-f5ee-4014-8dfc-826f389f1b9a req-bc800daf-0753-4a70-95b2-ff50341d92e6 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:06.906917 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-824f31cc-f5ee-4014-8dfc-826f389f1b9a req-bc800daf-0753-4a70-95b2-ff50341d92e6 service nova] Creating event network-changed:9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea for instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 on hv-cinder-83538 Sep 22 17:08:06.917059 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-824f31cc-f5ee-4014-8dfc-826f389f1b9a req-bc800daf-0753-4a70-95b2-ff50341d92e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054209 Sep 22 17:08:06.918170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 66/118] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:06.928606 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:06.929430 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:06.938345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:06.939001 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:06.939598 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:06.942850 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:06.943585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:06.944600 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:07.030411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:07.055833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-97d02875-b247-41d9-8f0d-af68af75c125 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 1.537109 Sep 22 17:08:07.058815 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 53/119] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:05 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:07.078876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:07.079947 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:07.087298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:07.089366 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:07.090729 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:07.091692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:07.092334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:07.092978 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:07.218462 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=24 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:07.371901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=4 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:07.668790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:07.680801 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:07.707383 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-dd0aeb20-2be9-44e7-b4e5-cd1e36a95d17 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 0.644164 Sep 22 17:08:07.712448 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 54/120] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:07 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:07.724095 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-58500ebd-8f70-4514-a228-5d29eeac0e89 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.802991 Sep 22 17:08:07.724095 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 67/121] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:06 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:07.783249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-604c9a71-5320-4c34-bae2-e945e2537eda req-a7f545f2-b428-46d4-9220-ec8c0d117b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f634f38-8ab0-4a46-a568-6bba89fc4bc3", "tag": "7447a832-846a-4c07-be5a-552ef92f9902"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:07.816175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:07.819042 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:07.849953 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-604c9a71-5320-4c34-bae2-e945e2537eda req-a7f545f2-b428-46d4-9220-ec8c0d117b3a service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:07.851187 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:07.853423 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:07.853907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:07.856088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-604c9a71-5320-4c34-bae2-e945e2537eda req-a7f545f2-b428-46d4-9220-ec8c0d117b3a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:07.858330 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:07.861358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:07.861811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:07.862767 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-604c9a71-5320-4c34-bae2-e945e2537eda req-a7f545f2-b428-46d4-9220-ec8c0d117b3a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:07.893663 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-604c9a71-5320-4c34-bae2-e945e2537eda req-a7f545f2-b428-46d4-9220-ec8c0d117b3a service nova] Creating event network-changed:7447a832-846a-4c07-be5a-552ef92f9902 for instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 on hv-cinder-83538 Sep 22 17:08:07.913093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-604c9a71-5320-4c34-bae2-e945e2537eda req-a7f545f2-b428-46d4-9220-ec8c0d117b3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168792 Sep 22 17:08:07.918284 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 55/122] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:07.946614 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:07.948617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:07.963385 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:07.964268 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:07.965323 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:07.966396 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:07.967342 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:07.968759 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:08.201875 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:08.220657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a3ce18af-1322-4401-a6a2-9bfe28cbdc86 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.477867 Sep 22 17:08:08.223347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 68/123] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:07 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:08.233005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:08.233637 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:08.237352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:08.250445 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:08.251520 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:08.252616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:08.253702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:08.254543 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:08.255200 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:08.259088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:08.262429 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:08.265332 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d55f3eee-ac32-43b7-b99b-bbd7a7eb1e4d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.340845 Sep 22 17:08:08.266115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 56/124] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:07 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:08.515005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:08.545882 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2047a6a3-0843-458f-af49-c6b4858bb3b9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.305490 Sep 22 17:08:08.545882 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 69/125] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:08 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:08.688644 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-23b0bbee-55eb-4bad-8bbe-d99df5ae35c0 req-369a4829-eacd-4070-97e7-4a42cbaaa770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7947f62-c48e-4f60-b109-295247f6e1aa", "name": "network-vif-plugged", "status": "completed", "tag": "d0d3ad94-b2b0-4603-b33c-ae0e3280fa0c"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:08.712971 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-23b0bbee-55eb-4bad-8bbe-d99df5ae35c0 req-369a4829-eacd-4070-97e7-4a42cbaaa770 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:08.713651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-23b0bbee-55eb-4bad-8bbe-d99df5ae35c0 req-369a4829-eacd-4070-97e7-4a42cbaaa770 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:08.715497 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-23b0bbee-55eb-4bad-8bbe-d99df5ae35c0 req-369a4829-eacd-4070-97e7-4a42cbaaa770 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:08.729076 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-23b0bbee-55eb-4bad-8bbe-d99df5ae35c0 req-369a4829-eacd-4070-97e7-4a42cbaaa770 service nova] Creating event network-vif-plugged:d0d3ad94-b2b0-4603-b33c-ae0e3280fa0c for instance b7947f62-c48e-4f60-b109-295247f6e1aa on hv-cinder-83538 Sep 22 17:08:08.735370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-23b0bbee-55eb-4bad-8bbe-d99df5ae35c0 req-369a4829-eacd-4070-97e7-4a42cbaaa770 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052471 Sep 22 17:08:08.736579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 57/126] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:08.772616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:08.774539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:08.787176 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:08.788395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:08.792774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:08.796490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:08.798221 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:08.799271 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:08.799410 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:08.800153 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:08.800764 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:08.801279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:08.801969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:08.803189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:08.803869 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:08.804499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:09.247919 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:09.263810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5261ea40-8910-4d72-9c9d-e46262b878da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.508971 Sep 22 17:08:09.264915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 70/127] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:08 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:09.274896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:09.277719 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:09.278634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:09.294754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d7e21ed6-30d4-4761-a5a3-43433b48c107 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 0.527204 Sep 22 17:08:09.300014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:09.300769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:09.303525 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:09.307262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:09.307935 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:09.309055 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:09.311149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 58/128] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:08 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:09.326458 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:09.327180 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:09.334860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:09.335781 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:09.336446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:09.337427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:09.338066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:09.338763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:09.709778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:09.724351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:09.752774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-74ea4d2a-1565-4a5a-afb2-03222e12013f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.484656 Sep 22 17:08:09.753901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 71/129] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:09 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:09.756564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:09.767187 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:09.779294 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-70298e02-df04-4edc-b4d6-56ded9cdd6d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.463816 Sep 22 17:08:09.791632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:09.794044 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:09.799955 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 59/130] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:09 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:09.814243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:09.814243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:09.814243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:09.814625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:09.815103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:09.819250 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:10.040598 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:10.049158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-994f64c2-0f4a-4169-96fd-279dccd47740 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.289915 Sep 22 17:08:10.050028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 72/131] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:09 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:10.303683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:10.305884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:10.334453 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:10.340503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:10.343902 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:10.347543 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:10.348305 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:10.351431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:10.356880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:10.358017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:10.363856 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:10.365282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:10.367441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:10.373868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:10.375088 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:10.377174 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:10.687247 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:10.688491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:10.700459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6d22a749-b815-43c7-b1ba-47b4fe29aabb tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1315 microversion: 2.1 time: 0.376514 Sep 22 17:08:10.701669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 73/132] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:10 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:10.723266 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7b49374c-9809-4f18-a560-7071ed51751f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.432943 Sep 22 17:08:10.728289 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 60/133] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:10 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:10.779201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:10.780436 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:10.789490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:10.790430 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:10.791172 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:10.792571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:10.793611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:10.794384 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:10.833869 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:10.834941 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:10.855682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:10.856524 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:10.857290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:10.860976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:10.861809 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:10.862807 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:11.082380 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:11.092783 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fc0a73d7-e604-4527-8972-0df8a7504ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.318372 Sep 22 17:08:11.107064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 74/134] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:10 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:11.111066 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:11.111938 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:11.119961 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:11.120159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:11.120939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:11.121584 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:11.122503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:11.123384 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:11.124034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:11.133200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:11.141226 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:11.143910 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d9704b36-e6a0-4c31-a4fd-7f54aa8f0cdc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.318094 Sep 22 17:08:11.144898 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 61/135] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:10 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:08:11.151582 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:11.314312 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:11.322693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-50c50258-221e-41fa-9eb7-e9ab81a31e49 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1363 microversion: 2.1 time: 0.221320 Sep 22 17:08:11.323541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 75/136] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:11 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:11.742044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:11.742654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:11.751622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:11.752796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:11.760804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:11.764616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:11.765139 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:11.767291 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:11.769006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:11.769506 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:11.777056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:11.777056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:11.777056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:11.777400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:11.777400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:11.777400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:11.777400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:12.041491 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:12.050648 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a37d299e-abe2-4113-9669-2a675649031a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.302649 Sep 22 17:08:12.053923 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 76/137] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:11 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:12.082177 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:12.096102 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5544219d-4c9e-42ee-86ae-3aedae4a3507 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1502 microversion: 2.1 time: 0.359206 Sep 22 17:08:12.096814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 62/138] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:11 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:12.123007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:12.124276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:12.138568 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:12.139559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:12.140315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:12.141547 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:12.142000 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:12.142583 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:12.186827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:12.187770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:12.201132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:12.201631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:12.202070 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:12.202997 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:12.207566 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:12.208315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:12.344532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:12.354175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-99cbe657-5223-4952-9279-a7bb861cf94c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.241354 Sep 22 17:08:12.363915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 77/139] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:12 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:12.371867 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:12.372502 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:12.393193 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:12.393695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:12.394126 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:12.394834 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:12.401012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:12.401652 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:13.343559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:13.355799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:13.357309 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:13.358465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-63d361cf-50fb-4ae1-9ad2-a90dfc0a249a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 1.176614 Sep 22 17:08:13.359059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 63/140] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:12 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:08:13.375927 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:13.376844 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:13.383393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:13.383885 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:13.384321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:13.385027 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:13.385488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:13.386586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:13.420892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:13.438898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a25806f1-add4-4d2a-8c01-0b80d54ac78c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1549 microversion: 2.1 time: 1.074086 Sep 22 17:08:13.459060 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 78/141] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:12 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1549 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:13.477960 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:13.478971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:13.488037 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:13.488935 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:13.489644 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:13.490981 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:13.491697 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:13.492359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:13.698478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:13.725391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-38f3ab7d-2047-45b6-ba1c-a28ad8519d8f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.364643 Sep 22 17:08:13.726540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 64/142] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:13 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:13.755008 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:13.771052 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-717de3c6-64a5-4bb1-a041-c0c0a5dd59f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.309293 Sep 22 17:08:13.772878 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 79/143] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:13 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:13.781697 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2e058fd7-14bf-4d28-b466-0a2377daf506 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:13.782415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2e058fd7-14bf-4d28-b466-0a2377daf506 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:13.798654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2e058fd7-14bf-4d28-b466-0a2377daf506 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:13.799349 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2e058fd7-14bf-4d28-b466-0a2377daf506 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:13.800026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2e058fd7-14bf-4d28-b466-0a2377daf506 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:13.801306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2e058fd7-14bf-4d28-b466-0a2377daf506 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:13.801852 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2e058fd7-14bf-4d28-b466-0a2377daf506 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:13.802378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2e058fd7-14bf-4d28-b466-0a2377daf506 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:13.957541 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2e058fd7-14bf-4d28-b466-0a2377daf506 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.216271 Sep 22 17:08:13.958143 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 65/144] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 22 17:08:13 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:13.976182 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bc716dea-5efe-4e83-b56e-4e3cc83f1dfe tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a43f268-747a-4509-bc9f-9241880436d5"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:13.976666 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bc716dea-5efe-4e83-b56e-4e3cc83f1dfe tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:13.989258 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc716dea-5efe-4e83-b56e-4e3cc83f1dfe tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:13.989902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc716dea-5efe-4e83-b56e-4e3cc83f1dfe tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:13.990350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc716dea-5efe-4e83-b56e-4e3cc83f1dfe tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:13.992239 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc716dea-5efe-4e83-b56e-4e3cc83f1dfe tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:13.993303 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc716dea-5efe-4e83-b56e-4e3cc83f1dfe tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:13.994085 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc716dea-5efe-4e83-b56e-4e3cc83f1dfe tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:14.384540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:14.385304 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:14.392280 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:14.392913 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:14.393443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:14.394245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:14.394793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:14.395355 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:15.007858 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:15.020060 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:15.027106 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:15.028679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-efe09b39-5913-4577-b316-85903bd96480 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.648183 Sep 22 17:08:15.044446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 66/145] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:14 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:08:15.070575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:15.072307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:15.079278 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:15.080020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:15.080708 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:15.081630 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:15.082257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:15.082840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:15.769443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:15.780612 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5c8ead77-c1db-4fe2-b4ec-094de8e0b85c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.718884 Sep 22 17:08:15.781635 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 67/146] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:15 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:15.786856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:15.787840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:15.796502 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:15.797602 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:15.798608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:15.799742 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:15.800640 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:15.801171 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:16.337524 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:16.353833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4eacab73-5537-4f5a-a98d-aa5af01c3d8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.570250 Sep 22 17:08:16.357199 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 68/147] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:15 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:16.371553 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-bc96b98d-0321-4d71-8019-205967987b46 req-4bd6589f-6cf5-460b-ae0f-864b0dd18965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2", "name": "network-vif-plugged", "status": "completed", "tag": "9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:16.398846 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-bc96b98d-0321-4d71-8019-205967987b46 req-4bd6589f-6cf5-460b-ae0f-864b0dd18965 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:16.400197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-bc96b98d-0321-4d71-8019-205967987b46 req-4bd6589f-6cf5-460b-ae0f-864b0dd18965 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:16.401287 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-bc96b98d-0321-4d71-8019-205967987b46 req-4bd6589f-6cf5-460b-ae0f-864b0dd18965 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:16.447008 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-bc96b98d-0321-4d71-8019-205967987b46 req-4bd6589f-6cf5-460b-ae0f-864b0dd18965 service nova] Creating event network-vif-plugged:9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea for instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 on hv-cinder-83538 Sep 22 17:08:16.462575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-bc96b98d-0321-4d71-8019-205967987b46 req-4bd6589f-6cf5-460b-ae0f-864b0dd18965 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101207 Sep 22 17:08:16.470385 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 69/148] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:16.499592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:16.503789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:16.546325 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:16.547637 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:16.551311 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:16.564707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:16.569115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:16.569746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:16.607502 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:16.929513 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:16.942609 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:16.951456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:16.953933 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8a52a974-c9f0-4a3b-bdd6-3dfa1ce4ccf7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.481988 Sep 22 17:08:16.956517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 70/149] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:16 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:16.971066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:16.971961 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:16.995712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:16.996250 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:16.996701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:16.998614 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:16.999123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:16.999558 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:17.521532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bc716dea-5efe-4e83-b56e-4e3cc83f1dfe tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "POST /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.552012 Sep 22 17:08:17.530368 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 80/150] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:08:13 2022] POST /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78/os-volume_attachments => generated 194 bytes in 3562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:17.541522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:17.544328 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:17.562430 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:17.566428 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:17.568057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:17.569401 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:17.572231 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:17.572845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:17.573908 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:18.150615 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:18.171382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ca0f658b-eb04-4fa4-a876-0d6e6e719519 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 1.209929 Sep 22 17:08:18.173825 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 71/151] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:16 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:18.191616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-5b77f6d6-1534-44ca-858f-475f57a20ee2 req-73e0c8d7-8134-415b-ab4d-5ed9811bfbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "979379b2-1673-4425-be3f-98d99729db47", "tag": "e62c689f-694f-4650-961c-8b16b6ed4e18"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:18.212162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-5b77f6d6-1534-44ca-858f-475f57a20ee2 req-73e0c8d7-8134-415b-ab4d-5ed9811bfbe5 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:18.216964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-5b77f6d6-1534-44ca-858f-475f57a20ee2 req-73e0c8d7-8134-415b-ab4d-5ed9811bfbe5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:18.218547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-5b77f6d6-1534-44ca-858f-475f57a20ee2 req-73e0c8d7-8134-415b-ab4d-5ed9811bfbe5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:18.243193 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-5b77f6d6-1534-44ca-858f-475f57a20ee2 req-73e0c8d7-8134-415b-ab4d-5ed9811bfbe5 service nova] Creating event network-changed:e62c689f-694f-4650-961c-8b16b6ed4e18 for instance 979379b2-1673-4425-be3f-98d99729db47 on hv-cinder-83538 Sep 22 17:08:18.257438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-5b77f6d6-1534-44ca-858f-475f57a20ee2 req-73e0c8d7-8134-415b-ab4d-5ed9811bfbe5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081789 Sep 22 17:08:18.258893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 72/152] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:18.264616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:18.278057 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:18.298693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:18.301782 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:18.302408 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:18.302905 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:18.304209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:18.304871 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:18.305668 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:18.312677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ec0a3c55-53ba-44ae-8556-d28cb27613c7 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.779246 Sep 22 17:08:18.322876 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 81/153] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:17 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:18.933554 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:18.956778 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:18.958321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:18.959537 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bf43c16b-bb72-40a6-ac5a-9847d01ce84c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.699265 Sep 22 17:08:18.982788 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 73/154] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:18 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:19.210716 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:19.212978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:19.227109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:19.228478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:19.230400 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:19.232592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:19.234072 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:19.235501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:19.344023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:19.345162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:19.354057 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:19.355703 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:19.357901 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:19.358972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:19.361249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:19.361853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:19.597437 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:19.614772 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-15cd1a37-80ed-41b0-b157-4b03e66a4393 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.411672 Sep 22 17:08:19.635891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 82/155] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:19 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:19.644833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-3d153978-2932-408d-84df-280b48669644 req-3e7e18d5-6893-4abd-936d-5d271a8bfc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb35797-a6cf-42af-9274-a2d6aadd2643", "name": "network-vif-plugged", "status": "completed", "tag": "fd0e7b8c-420d-4637-a290-d9a8014bf255"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:19.670802 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3d153978-2932-408d-84df-280b48669644 req-3e7e18d5-6893-4abd-936d-5d271a8bfc57 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:19.671320 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3d153978-2932-408d-84df-280b48669644 req-3e7e18d5-6893-4abd-936d-5d271a8bfc57 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:19.671755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3d153978-2932-408d-84df-280b48669644 req-3e7e18d5-6893-4abd-936d-5d271a8bfc57 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:19.718168 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-3d153978-2932-408d-84df-280b48669644 req-3e7e18d5-6893-4abd-936d-5d271a8bfc57 service nova] Creating event network-vif-plugged:fd0e7b8c-420d-4637-a290-d9a8014bf255 for instance cdb35797-a6cf-42af-9274-a2d6aadd2643 on hv-cinder-83538 Sep 22 17:08:19.731604 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-3d153978-2932-408d-84df-280b48669644 req-3e7e18d5-6893-4abd-936d-5d271a8bfc57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093202 Sep 22 17:08:19.739051 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:19.746291 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 83/156] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:19.748985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bf87d9cf-0931-4592-a652-36531c462990 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.412161 Sep 22 17:08:19.749806 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 74/157] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:19 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:19.996619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:19.998162 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:20.016242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:20.016756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:20.017193 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:20.017924 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:20.018387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:20.019586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:20.233455 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:20.243224 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:20.244762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:20.246501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-05a057d9-f357-4f0c-843a-93d0d1c54c4f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.256708 Sep 22 17:08:20.247513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 84/158] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:19 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:20.642339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:20.643084 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:20.649285 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:20.649855 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:20.650295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:20.651011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:20.651503 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:20.653107 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:20.775556 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:20.776211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:20.782478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:20.782997 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:20.783560 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:20.784275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:20.784728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:20.785181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:20.795799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:20.806829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1ef9a124-e606-4b96-8de4-8e8a02277a0d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.168821 Sep 22 17:08:20.807539 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 75/159] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:20 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:20.967235 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:20.976368 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-66b5322d-ca49-4247-950d-7d8854eeabc8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.206306 Sep 22 17:08:20.979796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 85/160] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:20 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:21.272569 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:21.273502 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:21.281280 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:21.282131 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:21.283097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:21.284572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:21.285336 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:21.286145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:21.441221 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:21.451053 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:21.452481 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:21.453586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-33a0c515-0f56-4045-92df-4c8661fe0ba7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1407 microversion: 2.20 time: 0.185810 Sep 22 17:08:21.454138 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 76/161] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:21 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:21.831282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:21.832021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:21.839501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:21.840051 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:21.840513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:21.841256 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:21.841712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:21.842140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:22.002698 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:22.003334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:22.010527 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:22.011703 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:22.012128 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:22.012872 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:22.013357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:22.014418 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:22.039856 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:22.048978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-51e40b33-dedc-4cf7-a3f7-cd4bb76c0bc5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.221645 Sep 22 17:08:22.051145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 86/162] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:21 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:22.172442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:22.180900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b910a0cd-5bfd-4777-bfb8-67a8933ec924 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.183187 Sep 22 17:08:22.181488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 77/163] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:21 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:22.481956 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:22.482684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:22.488759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:22.489243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:22.489677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:22.490381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:22.490873 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:22.491369 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:22.646189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:22.655955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:22.657602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:22.659379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8940b3a1-4a29-4493-a684-79508546d87c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1598 microversion: 2.20 time: 0.181979 Sep 22 17:08:22.660083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 87/164] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:08:22 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:08:22.695505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2278cd42-0ec0-4651-b94e-9dc48b1b65e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:22.696408 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2278cd42-0ec0-4651-b94e-9dc48b1b65e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:22.704640 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2278cd42-0ec0-4651-b94e-9dc48b1b65e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:22.705205 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2278cd42-0ec0-4651-b94e-9dc48b1b65e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:22.705917 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2278cd42-0ec0-4651-b94e-9dc48b1b65e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:22.706630 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2278cd42-0ec0-4651-b94e-9dc48b1b65e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:22.707291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2278cd42-0ec0-4651-b94e-9dc48b1b65e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:22.707736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2278cd42-0ec0-4651-b94e-9dc48b1b65e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:22.838501 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2278cd42-0ec0-4651-b94e-9dc48b1b65e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146682 Sep 22 17:08:22.840317 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 78/165] 10.222.0.16 () {60 vars in 1316 bytes} [Thu Sep 22 17:08:22 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:08:23.077710 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:23.078321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:23.085022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:23.085656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:23.086302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:23.087179 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:23.087896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:23.088398 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:23.205678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:23.206486 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:23.213999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:23.215146 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:23.215787 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:23.220007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:23.220007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:23.220007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:23.819745 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:23.830740 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dc2f295d-542a-4f60-ac1d-8e3331aef351 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.757370 Sep 22 17:08:23.831791 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 88/166] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:23 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:23.877111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:23.887677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-faaeb397-ce35-4f95-9d30-db97a5592d9a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.685618 Sep 22 17:08:23.888582 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 79/167] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:23 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:24.489779 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-1c475d1e-a3b1-49f9-b573-109421cf1448 req-938dc4ff-800b-4e6a-9249-f22bb82cc7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2", "tag": "9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:24.501405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1c475d1e-a3b1-49f9-b573-109421cf1448 req-938dc4ff-800b-4e6a-9249-f22bb82cc7e3 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:24.502406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1c475d1e-a3b1-49f9-b573-109421cf1448 req-938dc4ff-800b-4e6a-9249-f22bb82cc7e3 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:24.503208 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1c475d1e-a3b1-49f9-b573-109421cf1448 req-938dc4ff-800b-4e6a-9249-f22bb82cc7e3 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:24.518388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-1c475d1e-a3b1-49f9-b573-109421cf1448 req-938dc4ff-800b-4e6a-9249-f22bb82cc7e3 service nova] Creating event network-changed:9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea for instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 on hv-cinder-83538 Sep 22 17:08:24.525928 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-1c475d1e-a3b1-49f9-b573-109421cf1448 req-938dc4ff-800b-4e6a-9249-f22bb82cc7e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040615 Sep 22 17:08:24.527458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 89/168] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:24.856400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:24.857589 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:24.863908 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:24.864402 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:24.864832 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:24.865528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:24.865983 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:24.866391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:24.918910 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:24.920910 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:24.930237 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:24.931247 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:24.931892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:24.932915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:24.933696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:24.934510 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:25.127328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:25.136547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0ace68aa-2e64-40c4-b2ab-2a413bdd20f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.284755 Sep 22 17:08:25.137347 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 80/169] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:24 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:25.176407 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:25.192079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2f45de54-9162-4459-a8b8-6f3b81596f0f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.281974 Sep 22 17:08:25.192678 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 90/170] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:24 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:26.177109 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:26.177935 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:26.188244 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:26.189468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:26.190477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:26.191809 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:26.192982 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:26.194185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:26.217684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:26.219049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:26.226796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:26.227645 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:26.228306 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:26.229248 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:26.229977 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:26.234370 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:26.483465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:26.495809 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-14c875b7-ed55-49f9-9dc8-84b9f4daa90c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.321884 Sep 22 17:08:26.496414 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:26.496876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 81/171] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:26 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:26.504921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7be0e75a-2edf-462f-af0a-f692cb57b584 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.291661 Sep 22 17:08:26.505747 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 91/172] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:26 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:27.522108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:27.523008 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:27.530010 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:27.530505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:27.530939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:27.531677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:27.532127 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:27.532549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:27.551967 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:27.552819 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:27.560411 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:27.561005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:27.561506 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:27.562301 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:27.562753 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:27.563192 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:27.568067 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:27.759149 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:27.764392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:27.772422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9f37fca6-5e8d-46a8-bbbf-ffb312645b72 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.255547 Sep 22 17:08:27.773007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 82/173] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:27 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:27.774130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-77c96371-c97d-429a-b294-621d15e32931 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.229999 Sep 22 17:08:27.774820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 92/174] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:27 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:28.796161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:28.796777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:28.800072 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:28.801041 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:28.803562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:28.804058 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:28.804496 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:28.805203 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:28.805656 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:28.806086 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:28.807995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:28.808594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:28.809102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:28.809820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:28.810281 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:28.810708 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:29.013515 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:29.017920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:29.022195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8be7fae9-becc-4cfe-b6b8-4eb442e2c5b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.230562 Sep 22 17:08:29.023711 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 83/175] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:28 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:29.026117 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f0a183a7-d32e-4148-94d8-1faa6f9a0ff3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.230860 Sep 22 17:08:29.027353 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 93/176] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:28 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:30.048983 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:30.049592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:30.052235 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:30.053055 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:30.058200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:30.058780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:30.059361 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:30.060124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:30.060811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:30.061512 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:30.061696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:30.062397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:30.063126 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:30.064014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:30.064840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:30.065366 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:30.297260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:30.308668 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-74d5f0b8-78cd-4db7-be89-ef3a83b6edf7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1321 microversion: 2.1 time: 0.264073 Sep 22 17:08:30.309734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 84/177] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:30 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:30.310677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:30.315085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-5007732a-14af-463a-8952-05178f7054c2 req-5bda1a5e-4850-455b-bbe7-c824c1a5692b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f634f38-8ab0-4a46-a568-6bba89fc4bc3", "name": "network-vif-plugged", "status": "completed", "tag": "7447a832-846a-4c07-be5a-552ef92f9902"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:30.325803 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-5007732a-14af-463a-8952-05178f7054c2 req-5bda1a5e-4850-455b-bbe7-c824c1a5692b service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:30.326840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-5007732a-14af-463a-8952-05178f7054c2 req-5bda1a5e-4850-455b-bbe7-c824c1a5692b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:30.327538 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d48087a1-6167-4933-beb0-2a1b62b91875 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.280643 Sep 22 17:08:30.327792 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-5007732a-14af-463a-8952-05178f7054c2 req-5bda1a5e-4850-455b-bbe7-c824c1a5692b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:30.328706 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 94/178] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:30 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:30.341357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-5007732a-14af-463a-8952-05178f7054c2 req-5bda1a5e-4850-455b-bbe7-c824c1a5692b service nova] Creating event network-vif-plugged:7447a832-846a-4c07-be5a-552ef92f9902 for instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 on hv-cinder-83538 Sep 22 17:08:30.350656 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-5007732a-14af-463a-8952-05178f7054c2 req-5bda1a5e-4850-455b-bbe7-c824c1a5692b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039358 Sep 22 17:08:30.351376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 85/179] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:31.335285 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:31.335965 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:31.344032 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:31.344848 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:31.345374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:31.346089 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:31.346570 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:31.347016 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:31.375212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:31.376687 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:31.384000 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:31.388167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:31.388631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:31.389443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:31.389906 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:31.390331 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:31.552901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:31.562118 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-64cbbd37-5464-4984-98b5-b7aec44673f9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1514 microversion: 2.1 time: 0.231983 Sep 22 17:08:31.562920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 95/180] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:31 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:31.580162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:31.589391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-31b1cf45-f504-4e49-b06c-724cf1c963b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.225125 Sep 22 17:08:31.590080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:31.590253 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 86/181] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:31 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:31.595518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:31.603648 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:31.604145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:31.604627 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:31.605347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:31.605796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:31.606219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:31.630562 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lazy-loading 'flavor' on Instance uuid cdb35797-a6cf-42af-9274-a2d6aadd2643 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:08:31.769602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f97f820b-864a-414b-be1a-aa0012c95b13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643/action" status: 200 len: 32 microversion: 2.1 time: 0.186486 Sep 22 17:08:31.771187 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 96/182] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:08:31 2022] POST /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 17:08:31.801175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:31.803890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:31.814736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:31.815729 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:31.816257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:31.817028 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:31.817547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:31.818071 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:32.000112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:32.009999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f26eb568-9389-4a3d-a495-f4c0d4bba22a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.217214 Sep 22 17:08:32.011748 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 87/183] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:31 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:32.625542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:32.626832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:32.636711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:32.637449 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:32.638064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:32.639144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:32.639741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:32.640312 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:32.845271 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:32.862825 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d1244a5c-d9a9-468f-a3fa-fdecdbdc9ad0 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.241729 Sep 22 17:08:32.863997 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 97/184] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:32 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:32.963162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:32.964341 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:32.970472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:32.970998 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:32.971433 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:32.972133 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:32.972593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:32.973015 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:32.999920 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:08:33.002175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:33.039711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:33.040765 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:33.052377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:33.053183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:33.053977 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:33.055689 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:33.056484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:33.057265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:33.187007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a2cb783c-1614-42df-a920-59fab26a47ca tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 204 len: 0 microversion: 2.1 time: 0.222959 Sep 22 17:08:33.193144 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 88/185] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:08:32 2022] DELETE /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:08:33.258933 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:33.266655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:33.291692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:33.291692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:33.291994 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:33.293224 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:33.294562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:33.297042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:33.582181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:33.599908 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e4a29bf8-d916-4d72-9958-469cef148ce5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.564099 Sep 22 17:08:33.600829 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 98/186] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:33 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:33.859986 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:33.872252 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-61b47a19-6123-4606-892e-9346ffb48646 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1554 microversion: 2.1 time: 0.672484 Sep 22 17:08:33.873386 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 89/187] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:33 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1554 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:33.895538 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:33.897072 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:33.906593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:33.907776 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:33.908427 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:33.909313 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:33.910013 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:33.911116 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:34.130855 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:34.140056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e2469894-1411-4324-a18e-f12399fc7fe5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.248935 Sep 22 17:08:34.141467 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 99/188] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:33 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:34.625548 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:34.627486 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:34.637357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:34.637946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:34.638700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:34.639293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:34.639985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:34.641655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:34.861696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:34.877137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1f7ded11-0f35-4d14-a3a8-0f5ccf0521ef tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.257227 Sep 22 17:08:34.878124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 90/189] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:34 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:34.908161 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:34.909642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:34.927691 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:34.929220 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:34.930300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:34.936697 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:34.938192 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:34.938936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:35.165079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:35.165793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:35.173428 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:35.174189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:35.175413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:35.176840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:35.176993 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:35.177614 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:35.178144 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:35.200483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ab012269-cd28-4c1b-b7ae-fdd605d46d93 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1554 microversion: 2.1 time: 0.303253 Sep 22 17:08:35.211952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 100/190] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:34 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1554 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:35.371230 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:35.379700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5a56367f-743b-4c49-af82-a14bb94d5b6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1367 microversion: 2.1 time: 0.219553 Sep 22 17:08:35.387043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 91/191] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:35 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:35.905628 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:35.905628 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:35.914966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:35.915604 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:35.915897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:35.916719 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:35.917174 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:35.917605 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:36.196764 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:36.208587 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-690efe67-0a20-47f0-a050-3ee0bfa89505 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.310770 Sep 22 17:08:36.209182 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 101/192] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:35 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:36.234885 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:36.236092 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:36.244930 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:36.245976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:36.246720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:36.247853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:36.248467 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:36.249188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:36.405386 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:36.406388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:36.413446 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:36.414176 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:36.414958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:36.415699 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:36.416309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:36.417585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:36.884478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:36.894699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-38932573-3b01-4488-a36d-912a18d070c2 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1554 microversion: 2.1 time: 0.669128 Sep 22 17:08:36.908767 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 92/193] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:36 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1554 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:36.920181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:36.932583 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-01429993-1fd1-4480-88c3-4ceeec769b03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1557 microversion: 2.1 time: 0.530615 Sep 22 17:08:36.933960 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 102/194] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:36 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1557 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:36.958561 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b0ec5640-f588-4c7c-9ae8-e70c86bbc6de tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:36.959368 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b0ec5640-f588-4c7c-9ae8-e70c86bbc6de tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:36.966757 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0ec5640-f588-4c7c-9ae8-e70c86bbc6de tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:36.967542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0ec5640-f588-4c7c-9ae8-e70c86bbc6de tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:36.968115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0ec5640-f588-4c7c-9ae8-e70c86bbc6de tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:36.969090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0ec5640-f588-4c7c-9ae8-e70c86bbc6de tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:36.970331 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0ec5640-f588-4c7c-9ae8-e70c86bbc6de tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:36.970911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b0ec5640-f588-4c7c-9ae8-e70c86bbc6de tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:37.173407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b0ec5640-f588-4c7c-9ae8-e70c86bbc6de tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.218787 Sep 22 17:08:37.174009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 93/195] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 22 17:08:36 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-interface => generated 285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:37.240605 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:37.241851 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:37.254528 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:37.255391 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:37.259030 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:37.260028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:37.265134 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:37.265883 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:37.610602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:37.626140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bc619d98-42ce-4384-b59e-705a6d2d721d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.390403 Sep 22 17:08:37.629696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 103/196] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:37 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:37.918538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:37.919178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:37.931505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:37.932575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:37.944554 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:37.945384 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:37.945993 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:37.946427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:38.203708 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:38.215582 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-18abd226-ed39-4569-9db4-6679f2bd24d1 req-7af19baf-6985-4ce6-ac3d-8b37872a73a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed59422-e086-4f95-b56c-8dbe57faed78", "name": "network-vif-deleted", "tag": "4f54a4b6-ee55-4522-8820-9778a712cff0"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:38.220368 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8547a5be-2e97-449d-a822-8b3b8bf583d0 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1512 microversion: 2.1 time: 0.305810 Sep 22 17:08:38.224713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 94/197] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:37 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:38.230079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-18abd226-ed39-4569-9db4-6679f2bd24d1 req-7af19baf-6985-4ce6-ac3d-8b37872a73a5 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:38.230574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-18abd226-ed39-4569-9db4-6679f2bd24d1 req-7af19baf-6985-4ce6-ac3d-8b37872a73a5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:38.231170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-18abd226-ed39-4569-9db4-6679f2bd24d1 req-7af19baf-6985-4ce6-ac3d-8b37872a73a5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:38.254359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-18abd226-ed39-4569-9db4-6679f2bd24d1 req-7af19baf-6985-4ce6-ac3d-8b37872a73a5 service nova] Creating event network-vif-deleted:4f54a4b6-ee55-4522-8820-9778a712cff0 for instance 6ed59422-e086-4f95-b56c-8dbe57faed78 on hv-cinder-83538 Sep 22 17:08:38.264500 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-18abd226-ed39-4569-9db4-6679f2bd24d1 req-7af19baf-6985-4ce6-ac3d-8b37872a73a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061755 Sep 22 17:08:38.269032 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 104/198] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:08:38.654040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:38.654932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:38.661231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:38.661722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:38.662155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:38.662855 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:38.663334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:38.663754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:38.846645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:38.859942 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-83359682-8b40-4ea8-92fc-e6cc9ac52e79 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.210068 Sep 22 17:08:38.861241 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 95/199] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:38 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:39.271306 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:39.272160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:39.286149 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:39.287484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:39.289173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:39.290406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:39.291190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:39.291826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:39.367649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:39.368546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:39.372624 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:39.373275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lazy-loading 'fault' on Instance uuid 6ed59422-e086-4f95-b56c-8dbe57faed78 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:08:39.470241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3725446c6d5040c7870b056d4bfbeca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b4f8716fa84e439293149dd10cac82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:39.482144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0bc9deb6-796c-4533-bb4b-e6a38db151a6 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 200 len: 1351 microversion: 2.1 time: 0.215383 Sep 22 17:08:39.485364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 105/200] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:39 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 1351 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:39.614269 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-7f140079-2239-47af-a7a8-73c1ab3dc5a4 req-81a38469-901d-48a9-b775-29a9c6e583a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f634f38-8ab0-4a46-a568-6bba89fc4bc3", "tag": "7447a832-846a-4c07-be5a-552ef92f9902"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:39.623823 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-7f140079-2239-47af-a7a8-73c1ab3dc5a4 req-81a38469-901d-48a9-b775-29a9c6e583a7 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:39.624299 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-7f140079-2239-47af-a7a8-73c1ab3dc5a4 req-81a38469-901d-48a9-b775-29a9c6e583a7 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:39.624745 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-7f140079-2239-47af-a7a8-73c1ab3dc5a4 req-81a38469-901d-48a9-b775-29a9c6e583a7 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:39.637493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-7f140079-2239-47af-a7a8-73c1ab3dc5a4 req-81a38469-901d-48a9-b775-29a9c6e583a7 service nova] Creating event network-changed:7447a832-846a-4c07-be5a-552ef92f9902 for instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 on hv-cinder-83538 Sep 22 17:08:39.642909 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-7f140079-2239-47af-a7a8-73c1ab3dc5a4 req-81a38469-901d-48a9-b775-29a9c6e583a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032319 Sep 22 17:08:39.643557 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 96/201] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:39.847098 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-747784988", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "networks": [{"uuid": "e3d57eb8-841d-4942-9243-4eda619be6ae"}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:39.903594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:39.907278 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:39.938491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:39.939402 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:39.940461 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:39.942399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:39.945045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:39.945804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:40.031231 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] validate_networks() for [('e3d57eb8-841d-4942-9243-4eda619be6ae', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:08:40.488048 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:40.497758 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6f9784e2-ff16-4c99-9ea8-bc4f408dd6f3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.612617 Sep 22 17:08:40.498734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 97/202] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:39 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:40.516314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:40.516933 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:40.523506 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:40.524005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:40.524446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:40.525148 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:40.526655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:40.527196 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:40.544335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] HTTP exception thrown: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Request method failure captured: Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 HTTP/1.1 Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZDk0fcX3saPZ-cECT2M49Wf07OM0Kr4RE9XCfyvEbKHTxgFeU8dvbW5EYUc2MTpOqNcBYaHOzjo24BOodf7Q1Htx-VvZlpmavcbuvuh91ZMJKPndpcnJgk7NXdzxhH6QA6ZQgtziWKTZrbFymeR3w60FOIDlVJ-P2N-JRCv1hHB-E Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 70b4f8716fa84e439293149dd10cac82 Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:08:40.559769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b4f8716fa84e439293149dd10cac82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 70b4f8716fa84e439293149dd10cac82 Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-DeleteServersTestJSON-388673952-project Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 3725446c6d5040c7870b056d4bfbeca6 Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-DeleteServersTestJSON-388673952-project Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.561334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '6ed59422-e086-4f95-b56c-8dbe57faed78'} Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:08:40.562701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.564059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.566234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Returning 404 to user: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:08:40.566234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-558ab13c-4a3a-4a4a-82b2-a4be27117e26 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 404 len: 111 microversion: 2.1 time: 0.049065 Sep 22 17:08:40.566234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 98/203] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:40 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:08:40.814061 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:40.817237 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:40.825480 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:40.826353 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:40.827164 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:40.832097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:40.832747 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:40.833363 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:40.849389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] HTTP exception thrown: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Request method failure captured: Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78/os-volume_attachments HTTP/1.1 Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZDk0fcX3saPZ-cECT2M49Wf07OM0Kr4RE9XCfyvEbKHTxgFeU8dvbW5EYUc2MTpOqNcBYaHOzjo24BOodf7Q1Htx-VvZlpmavcbuvuh91ZMJKPndpcnJgk7NXdzxhH6QA6ZQgtziWKTZrbFymeR3w60FOIDlVJ-P2N-JRCv1hHB-E Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 70b4f8716fa84e439293149dd10cac82 Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:08:40.851777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b4f8716fa84e439293149dd10cac82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 70b4f8716fa84e439293149dd10cac82 Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-DeleteServersTestJSON-388673952-project Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 3725446c6d5040c7870b056d4bfbeca6 Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-DeleteServersTestJSON-388673952-project Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.853212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'server_id': '6ed59422-e086-4f95-b56c-8dbe57faed78'} Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:08:40.854137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:40.855585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:40.857645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Returning 404 to user: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:08:40.858716 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d91441c8-a768-4220-8fbe-c5197696c133 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050640 Sep 22 17:08:40.859456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 99/204] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:08:40 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:08:41.327143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:08:41.327143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:08:41.327143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:08:41.327143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:08:41.327143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:08:41.339377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:41.340255 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:41.341076 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:41.342587 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:41.344136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:41.345162 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:41.373218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Getting quotas for project 78cce6768e1a473f9056d179b605df6d. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:08:41.377926 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Getting quotas for user 4386cce77ec047f480e9999aeb103da5 and project 78cce6768e1a473f9056d179b605df6d. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:08:41.392773 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:08:41.395407 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:08:41.450051 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bf24df32-3b99-47f5-8641-21617f0c634f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609962 Sep 22 17:08:41.450996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 106/205] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:08:41.462806 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a90c2a6f-26b0-48c5-99b1-bf963bde3b96 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:41.463978 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a90c2a6f-26b0-48c5-99b1-bf963bde3b96 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:41.526444 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:41.527626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:41.538122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a90c2a6f-26b0-48c5-99b1-bf963bde3b96 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:41.548079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a90c2a6f-26b0-48c5-99b1-bf963bde3b96 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1218 microversion: 2.1 time: 0.089213 Sep 22 17:08:41.549283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 100/206] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:41 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:41.554596 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:41.555914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:41.556520 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:41.557974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:41.558776 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:41.559495 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:41.779910 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:41.784335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:41.791068 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-30400aa8-2a92-4b5d-8330-7877a05d682e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.272274 Sep 22 17:08:41.792569 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 107/207] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:41 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:42.254760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:42.255504 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:42.257795 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:42.265011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:42.265555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:42.266021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:42.266756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:42.267260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:42.267686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:42.285574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] HTTP exception thrown: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Request method failure captured: Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: DELETE /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 HTTP/1.1 Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZDk0fcX3saPZ-cECT2M49Wf07OM0Kr4RE9XCfyvEbKHTxgFeU8dvbW5EYUc2MTpOqNcBYaHOzjo24BOodf7Q1Htx-VvZlpmavcbuvuh91ZMJKPndpcnJgk7NXdzxhH6QA6ZQgtziWKTZrbFymeR3w60FOIDlVJ-P2N-JRCv1hHB-E Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 70b4f8716fa84e439293149dd10cac82 Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:08:42.287254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b4f8716fa84e439293149dd10cac82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 70b4f8716fa84e439293149dd10cac82 Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-DeleteServersTestJSON-388673952-project Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 3725446c6d5040c7870b056d4bfbeca6 Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-DeleteServersTestJSON-388673952-project Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.288828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '6ed59422-e086-4f95-b56c-8dbe57faed78'} Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:08:42.289593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.290700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.292205 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Returning 404 to user: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:08:42.292205 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1e157441-1fea-4e30-be4d-79cb64857d91 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 404 len: 111 microversion: 2.1 time: 0.040302 Sep 22 17:08:42.292205 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 101/208] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:08:42 2022] DELETE /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:08:42.298532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:42.299278 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] [instance: 6ed59422-e086-4f95-b56c-8dbe57faed78] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:42.308247 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:42.308741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:42.309173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:42.309881 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:42.310359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:42.310992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:42.326889 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] HTTP exception thrown: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Request method failure captured: Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 HTTP/1.1 Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZDk0fcX3saPZ-cECT2M49Wf07OM0Kr4RE9XCfyvEbKHTxgFeU8dvbW5EYUc2MTpOqNcBYaHOzjo24BOodf7Q1Htx-VvZlpmavcbuvuh91ZMJKPndpcnJgk7NXdzxhH6QA6ZQgtziWKTZrbFymeR3w60FOIDlVJ-P2N-JRCv1hHB-E Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 70b4f8716fa84e439293149dd10cac82 Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:08:42.331632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70b4f8716fa84e439293149dd10cac82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70b4f8716fa84e439293149dd10cac82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 70b4f8716fa84e439293149dd10cac82 Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-DeleteServersTestJSON-388673952 Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-DeleteServersTestJSON-388673952-project Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: 3725446c6d5040c7870b056d4bfbeca6 Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-DeleteServersTestJSON-388673952-project Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.333539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '6ed59422-e086-4f95-b56c-8dbe57faed78'} Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:08:42.334646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. Sep 22 17:08:42.335994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:08:42.338438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] Returning 404 to user: Instance 6ed59422-e086-4f95-b56c-8dbe57faed78 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:08:42.339504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c74c4e2e-9317-4afc-91b7-98930b904ef1 tempest-DeleteServersTestJSON-388673952 tempest-DeleteServersTestJSON-388673952-project] 10.222.0.16 "GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78" status: 404 len: 111 microversion: 2.1 time: 0.045730 Sep 22 17:08:42.340082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 108/209] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:42 2022] GET /compute/v2.1/servers/6ed59422-e086-4f95-b56c-8dbe57faed78 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:08:42.585828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:42.586481 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:42.601357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:42.602023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:42.602462 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:42.603218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:42.604073 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:42.607049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:42.764525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:42.777140 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-495c8958-4980-4aa2-af4d-17253f56a643 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1270 microversion: 2.1 time: 0.204141 Sep 22 17:08:42.778928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 102/210] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:42 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:42.827577 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:42.829147 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:42.849977 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:42.851432 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:42.853267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:42.855179 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:42.855952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:42.859170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:43.100728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:43.120992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-09f5f31d-e75d-42a3-af2f-e3d60a5e03c3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.306058 Sep 22 17:08:43.140177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 109/211] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:42 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:43.808335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:43.809153 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:43.820797 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:43.821296 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:43.822033 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:43.823083 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:43.823208 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:43.823584 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:43.968813 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:43.988495 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f6357201-1d4a-4b2f-8fc8-4734d2df73b0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1276 microversion: 2.1 time: 0.184862 Sep 22 17:08:43.989912 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 103/212] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:43 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:44.172312 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:44.173662 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:44.181092 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:44.181593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:44.182916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:44.183827 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:44.184453 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:44.184906 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:44.491605 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:44.509848 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-eb6301f4-50f5-46f4-bf7d-d1a4d7a57168 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.337171 Sep 22 17:08:44.510671 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 110/213] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:44 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:45.017548 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:45.019142 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:45.031878 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:45.033946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:45.034721 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:45.035845 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:45.037683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:45.038298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:45.418485 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:45.433197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-604cfa86-e1db-4358-a166-9e7075cef8c3 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.422050 Sep 22 17:08:45.434741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 104/214] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:45 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:45.539188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:45.540525 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:45.549470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:45.550495 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:45.551175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:45.552266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:45.553043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:45.553657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:45.854774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:45.876073 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2e7c86df-0343-470f-8692-a9b60a3eb7f0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.337475 Sep 22 17:08:45.881598 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 111/215] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:45 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:46.102087 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-c19a248f-1848-4441-ac82-50f212fe15a8 req-6088c0ea-0629-429b-82b8-e8ee51aaca34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34975170-3fed-4365-af86-d8375013ad5c", "tag": "90ee9eab-8000-4105-98b8-1323d939e7e8"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:46.126707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c19a248f-1848-4441-ac82-50f212fe15a8 req-6088c0ea-0629-429b-82b8-e8ee51aaca34 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:46.127366 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c19a248f-1848-4441-ac82-50f212fe15a8 req-6088c0ea-0629-429b-82b8-e8ee51aaca34 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:46.127804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c19a248f-1848-4441-ac82-50f212fe15a8 req-6088c0ea-0629-429b-82b8-e8ee51aaca34 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:46.149329 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-c19a248f-1848-4441-ac82-50f212fe15a8 req-6088c0ea-0629-429b-82b8-e8ee51aaca34 service nova] Creating event network-changed:90ee9eab-8000-4105-98b8-1323d939e7e8 for instance 34975170-3fed-4365-af86-d8375013ad5c on hv-cinder-83538 Sep 22 17:08:46.160894 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-c19a248f-1848-4441-ac82-50f212fe15a8 req-6088c0ea-0629-429b-82b8-e8ee51aaca34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066142 Sep 22 17:08:46.161754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 105/216] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:08:46.470077 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:46.470772 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:46.479982 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:46.480820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:46.481426 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:46.482367 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:46.482970 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:46.483497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:46.821201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:46.842183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5f7a9268-b0eb-4dc3-a0a5-5f8b69aa89d8 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.374914 Sep 22 17:08:46.844133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 112/217] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:46 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:46.915026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:46.917039 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:46.933885 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:46.934875 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:46.935857 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:46.939655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:46.941104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:46.942093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:47.223154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:47.241392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-88abde2b-d01e-4cc5-9462-7cc0818a98f1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.336851 Sep 22 17:08:47.242679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 106/218] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:46 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:47.868204 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:47.870734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:47.881450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:47.887318 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:47.891417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:47.891989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:47.893268 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:47.893869 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:47.894305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:48.266683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:48.268388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:48.276312 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:48.277075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:48.277685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:48.278854 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:48.279594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:48.280283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:48.297939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:48.311089 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ff81bef1-671c-4080-80ef-301401beda70 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.447022 Sep 22 17:08:48.326868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 113/219] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:47 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:48.608169 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:48.622360 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-96800c4c-fff7-4a9d-b848-7814867cd5a5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.360332 Sep 22 17:08:48.623315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 107/220] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:48 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:49.344197 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:49.345362 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:49.354301 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:49.355140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:49.355792 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:49.357311 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:49.357977 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:49.358626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:49.568909 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:49.584012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e2aa0d5b-79ac-48d1-9049-2cbabe53b8ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.245775 Sep 22 17:08:49.584934 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 114/221] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:49 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:49.648435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:49.649303 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:49.657604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:49.658039 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:49.658695 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:49.659601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:49.660068 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:49.660496 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:49.698276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:49.944343 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:49.956393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-300b9390-beee-4c5d-a8c3-f6c285a8d799 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.311991 Sep 22 17:08:49.957181 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 108/222] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:49 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:50.610664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:50.612183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:50.623010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:50.623512 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:50.623951 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:50.624835 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:50.625355 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:50.625717 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:50.791422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:50.808852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-80e1e9e6-a97c-49cb-b619-e21c943f0533 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.204151 Sep 22 17:08:50.809447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 115/223] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:50 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:50.982024 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:50.983409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:50.990144 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:50.990364 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:50.990741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:50.991697 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:50.992149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:50.992738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:51.450570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:51.459133 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f08e4b15-0d38-4807-a7b1-994fc21ade1a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.482391 Sep 22 17:08:51.459715 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 109/224] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:50 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:51.839606 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:51.840895 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:51.851127 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:51.851914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:51.857669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:51.858260 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:51.858769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:51.859994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:51.860537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:51.861031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:52.061983 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:52.074749 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6f539812-f918-41e2-a65f-a495fb478c0a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.241234 Sep 22 17:08:52.075940 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 116/225] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:51 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:52.495053 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:52.495889 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:52.497664 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:08:52.503811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:52.504389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:52.504892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:52.505666 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:52.506187 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:52.506674 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:52.705805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:52.714044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d340d485-b1dd-407c-98e5-ad899ac07cda tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.222904 Sep 22 17:08:52.714618 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 110/226] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:52 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:53.109378 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:53.110071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:53.118310 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:53.118886 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:53.119856 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:53.120577 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:53.121083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:53.121410 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:53.289210 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:53.301475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-431a6f28-8ef5-4a72-87e7-84664131f3ed tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.195635 Sep 22 17:08:53.302459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 117/227] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:53 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:53.738375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:53.739126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:53.748854 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:53.749734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:53.750474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:53.751897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:53.752674 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:53.753386 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:53.912579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:53.922025 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1e288652-3c60-462c-8b82-a2e431ee6cb0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.188323 Sep 22 17:08:53.922657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 111/228] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:53 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:54.336352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:54.337420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:54.346903 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:54.347645 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:54.348549 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:54.348821 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:54.349559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:54.350079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:54.523404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:54.534479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ec5fba2e-1cda-4180-ad04-d3eb849635b2 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.202565 Sep 22 17:08:54.535232 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 118/229] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:54 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:08:54.946015 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:54.946675 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:54.953766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:54.954248 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:54.954682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:54.955402 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:54.955875 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:54.956279 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:55.101089 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:55.109308 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5966ad3a-83eb-48df-b2ba-2578cd8dd876 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.167367 Sep 22 17:08:55.109899 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 112/230] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:54 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:55.567034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:55.567706 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:55.574902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:55.575420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:55.575863 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:55.576567 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:55.577847 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:55.577847 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:55.846887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:55.855190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-369fe4c1-aa5a-4537-ac79-6c86b3b612d6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.292030 Sep 22 17:08:55.855762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 119/231] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:55 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:56.132817 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:56.133413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:56.139876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:56.140351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:56.140776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:56.141453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:56.141904 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:56.142312 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:56.277081 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:56.284890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-22a123b3-9fc5-45fc-9a1d-758c7fe00f1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.155949 Sep 22 17:08:56.285468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 113/232] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:56 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:56.877888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:56.878735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:56.885123 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:56.885605 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:56.886029 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:56.886717 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:56.887211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:56.887632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:57.038996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:57.050553 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1669e1d6-b3b2-47e6-b631-50a776225b37 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.176228 Sep 22 17:08:57.051263 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 120/233] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:56 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:57.308448 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:57.309421 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:57.316890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:57.321660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:57.321660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:57.321660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:57.321660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:57.328382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:57.501006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:57.510678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4b17590a-21ed-4f08-962d-69b89bc11026 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.206707 Sep 22 17:08:57.511847 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 114/234] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:57 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:58.087363 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:58.088389 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:58.095073 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:58.095629 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:58.096057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:58.096763 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:58.097775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:58.097775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:58.249738 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:58.263614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1bfb7570-0b16-42c4-a1aa-62b4fe571853 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.179874 Sep 22 17:08:58.264595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 121/235] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:58 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:58.419580 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-0cc7874d-b73e-4736-b538-99ecc2f1bb2e req-523a901f-d2bd-4608-a3e9-7227ec18f1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34975170-3fed-4365-af86-d8375013ad5c", "name": "network-vif-plugged", "status": "completed", "tag": "90ee9eab-8000-4105-98b8-1323d939e7e8"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:08:58.432499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0cc7874d-b73e-4736-b538-99ecc2f1bb2e req-523a901f-d2bd-4608-a3e9-7227ec18f1c8 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:58.433542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0cc7874d-b73e-4736-b538-99ecc2f1bb2e req-523a901f-d2bd-4608-a3e9-7227ec18f1c8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:58.434501 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0cc7874d-b73e-4736-b538-99ecc2f1bb2e req-523a901f-d2bd-4608-a3e9-7227ec18f1c8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:58.448941 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-0cc7874d-b73e-4736-b538-99ecc2f1bb2e req-523a901f-d2bd-4608-a3e9-7227ec18f1c8 service nova] Creating event network-vif-plugged:90ee9eab-8000-4105-98b8-1323d939e7e8 for instance 34975170-3fed-4365-af86-d8375013ad5c on hv-cinder-83538 Sep 22 17:08:58.460075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-0cc7874d-b73e-4736-b538-99ecc2f1bb2e req-523a901f-d2bd-4608-a3e9-7227ec18f1c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047527 Sep 22 17:08:58.461030 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 115/236] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:08:58.560401 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:58.561019 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:58.578608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:58.579351 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:58.579883 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:58.580896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:58.581565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:58.582821 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:58.809249 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:58.819140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e01f9cea-b2ae-4e2c-874a-1e6383bea7ca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.265639 Sep 22 17:08:58.819868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 122/237] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:58 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:59.295328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:59.296023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:59.302875 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:59.303394 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:59.303822 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:59.304531 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:59.304972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:59.305393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:59.517976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:08:59.532976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-739573cb-b5e0-45fb-a82e-fa33e732507a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.241922 Sep 22 17:08:59.533999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 116/238] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:59 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:08:59.845807 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:08:59.846632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:08:59.855390 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:59.855997 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:59.856512 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:08:59.857790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:08:59.858464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:08:59.859239 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:00.076731 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:00.096391 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e0b94cdc-1df7-4079-9d6f-acb630394671 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.255575 Sep 22 17:09:00.096999 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 123/239] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:08:59 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:00.581056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:00.583208 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:00.595566 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:00.596763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:00.597768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:00.599382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:00.600497 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:00.601494 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:00.828607 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:00.838111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ec64f939-3e03-40db-be66-cd5c98be48fb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.264224 Sep 22 17:09:00.839102 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 117/240] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:00 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:01.124111 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:01.125194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:01.135161 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:01.136013 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:01.136470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:01.137271 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:01.137700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:01.138121 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:01.317597 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:01.326985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9462cf96-875a-4e89-8a89-6be8e60efd03 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.210373 Sep 22 17:09:01.331172 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 124/241] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:01 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:01.883262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:01.884873 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:01.892710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:01.893555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:01.893995 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:01.894718 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:01.895276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:01.895693 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:02.139228 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:02.154120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b53131da-9057-4d6d-b314-2e3d6dd201b7 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.279886 Sep 22 17:09:02.155163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 118/242] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:01 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:02.369894 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:02.370621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:02.378896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:02.379786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:02.380308 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:02.381189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:02.381728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:02.382585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:02.411160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:02.752302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:02.782485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-971b24c3-276a-4401-9fb6-de94ad7a6d84 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.416636 Sep 22 17:09:02.792479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 125/243] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:02 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:03.196422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:03.197730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:03.210514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:03.211781 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:03.213635 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:03.215353 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:03.216954 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:03.217949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:03.524025 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:03.542149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c2ae796b-32d6-4d99-a722-26c4d32588f1 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.351944 Sep 22 17:09:03.543555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 119/244] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:03 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:03.824193 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:03.825010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:03.837890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:03.838608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:03.839325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:03.840453 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:03.841733 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:03.842803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:04.069654 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:04.083457 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b9213cc7-af6f-4915-b4cd-710bea5a4b8c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.264134 Sep 22 17:09:04.086332 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 126/245] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:03 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:04.583399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:04.584958 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:04.594130 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:04.594652 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:04.595322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:04.596608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:04.597340 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:04.598023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:04.797789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:04.807597 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4ea3aad0-768f-4678-bb52-9318360347a5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1318 microversion: 2.1 time: 0.228711 Sep 22 17:09:04.809342 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 120/246] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:04 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:05.135976 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:05.137245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:05.151607 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:05.152483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:05.153157 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:05.154406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:05.155812 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:05.156517 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:05.335412 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:05.349712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-44b7b2c3-42fc-4d25-bece-107c7456697c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.218304 Sep 22 17:09:05.355802 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 127/247] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:05 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:05.851209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:05.851888 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:05.863931 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:05.872727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:05.873498 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:05.874990 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:05.876046 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:05.878468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:06.195647 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:06.208098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6deb0059-7d0b-4a72-9f84-603e73779fab tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1506 microversion: 2.1 time: 0.362461 Sep 22 17:09:06.208709 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 121/248] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:05 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:06.385498 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:06.386299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:06.397808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:06.401549 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:06.402242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:06.403203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:06.404549 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:06.405565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:06.781457 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:06.793770 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-700954ce-3def-484d-8eb1-37c14fe5a58d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.415738 Sep 22 17:09:06.795621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 128/249] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:06 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:07.092455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-844250263", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "networks": [{"uuid": "5f2097d8-b178-40e5-9027-cc66e5236eeb"}]}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:07.189900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] validate_networks() for [('5f2097d8-b178-40e5-9027-cc66e5236eeb', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:09:07.824655 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:07.825521 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:07.854431 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:07.856002 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:07.856657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:07.858902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:07.860373 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:07.861481 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:07.863071 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:09:07.863576 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:09:07.864220 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:09:07.864850 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:09:07.865687 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:09:07.903431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:07.903906 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:07.904364 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:07.905120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:07.905574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:07.906185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:07.990365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Getting quotas for project 6c516bf5715a42cd860981f82fc58b15. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:09:08.001466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Getting quotas for user 2ad9fb3dd77d47c190e14cf504ea4d3d and project 6c516bf5715a42cd860981f82fc58b15. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:09:08.044139 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:09:08.047136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:09:08.233201 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cc20b93b-89cf-41c7-951e-42f1baa140fd tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150012 Sep 22 17:09:08.237685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 122/250] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:09:08.259573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2c3c3a97-4381-4ed3-9880-97493e4312ba tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:08.260541 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2c3c3a97-4381-4ed3-9880-97493e4312ba tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:08.457240 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:08.457547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2c3c3a97-4381-4ed3-9880-97493e4312ba tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:08.472479 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2c3c3a97-4381-4ed3-9880-97493e4312ba tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1213 microversion: 2.1 time: 0.219389 Sep 22 17:09:08.474677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 123/251] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:08 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1213 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:08.520733 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-47623374-8cc6-4e7c-b8de-6e76966c9736 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.704368 Sep 22 17:09:08.531022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 129/252] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:07 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:09.509738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:09.510673 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:09.517897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:09.518551 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:09.519031 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:09.520631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:09.525224 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:09.525491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:09.556593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:09.558122 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:09.582344 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:09.584576 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:09.585300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:09.587283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:09.588325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:09.589024 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:09.689996 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:09.703414 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-81381f5f-25d4-4fa8-9ab6-d209915eb08d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1217 microversion: 2.1 time: 0.201020 Sep 22 17:09:09.707177 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 124/253] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:09 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1217 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:09.871696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:09.884371 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-64af160d-6c1e-4af9-bf10-efff8a6a0396 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1520 microversion: 2.1 time: 0.334657 Sep 22 17:09:09.902014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 130/254] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:09 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:10.736212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:10.737737 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:10.752010 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:10.753526 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:10.754677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:10.756357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:10.757951 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:10.759203 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:10.914770 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:10.915402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:10.926100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:10.927487 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:10.930367 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:10.932159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:10.933574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:10.936320 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:10.985345 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:10.997142 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cb942ef3-d0de-4bf1-880c-8e41f7c281b6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1265 microversion: 2.1 time: 0.271661 Sep 22 17:09:10.998719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 125/255] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:10 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:11.270323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:11.281845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-831a3800-1fb8-4148-9822-e7c3a4f02a78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1500 microversion: 2.1 time: 0.375387 Sep 22 17:09:11.283124 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 131/256] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:10 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1500 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:11.320315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:11.320976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:11.336422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:11.339374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:11.339915 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:11.341552 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:11.342289 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:11.345122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:11.671594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:11.690199 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3bacd451-d82c-4811-8f55-2e17b077cff8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1514 microversion: 2.1 time: 0.385690 Sep 22 17:09:11.706284 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 126/257] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:11 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1514 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:12.024534 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:12.027180 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:12.056151 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:12.057074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:12.059096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:12.067228 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:12.068135 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:12.068944 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:12.330878 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:12.342978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d0d5d84f-b1e3-4e50-9645-70d13c64a995 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1273 microversion: 2.1 time: 0.325244 Sep 22 17:09:12.356114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 132/258] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:12 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:13.371832 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:13.372558 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:13.382467 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:13.388243 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:13.391462 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:13.392431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:13.396687 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:13.397448 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:13.403885 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:13.448549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:13.780347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:13.783189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:13.794695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:13.795219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:13.795698 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:13.796401 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:13.796853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:13.797270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:13.857146 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:13.879138 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4fcb864d-95ea-41e7-abae-d9804f988bfe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1271 microversion: 2.1 time: 0.513604 Sep 22 17:09:13.881372 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lazy-loading 'flavor' on Instance uuid b7947f62-c48e-4f60-b109-295247f6e1aa {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:09:13.881859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 127/259] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:13 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1271 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:14.080967 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a47b96b8-5b79-4b39-938f-06059ce87f54 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa/action" status: 200 len: 32 microversion: 2.1 time: 0.320703 Sep 22 17:09:14.088085 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 133/260] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:09:13 2022] POST /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 17:09:14.092943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:14.093618 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:14.111314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:14.111843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:14.114544 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:14.117212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:14.117910 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:14.123060 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:14.930756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:14.931987 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:14.940052 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:14.940796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:14.941389 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:14.942299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:14.942924 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:14.943664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:15.053758 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:15.069383 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-08dd1408-a001-4e39-aa66-0f99c9c16242 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.973380 Sep 22 17:09:15.070200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 128/261] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:14 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:15.135591 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:15.150502 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-65063000-367a-4a28-bb3a-340efc7daed4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1271 microversion: 2.1 time: 0.226366 Sep 22 17:09:15.151773 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 134/262] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:14 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1271 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:16.116097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:16.116740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:16.136849 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:16.141510 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:16.142542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:16.167490 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:16.168073 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:16.168524 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:16.180253 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:16.181568 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:16.192133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:16.192941 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:16.193614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:16.197961 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:16.198778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:16.199644 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:16.703088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:16.709504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:16.722915 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-77601834-e7b7-40f7-8fce-a354a7f717f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.625486 Sep 22 17:09:16.735005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 129/263] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:16 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:16.735208 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0a2a65b2-8706-4773-8a80-43422260ebf9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.555787 Sep 22 17:09:16.735208 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 135/264] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:16 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:17.748226 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:17.749194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:17.756389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:17.756879 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:17.757306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:17.758155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:17.763608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:17.764036 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:17.764036 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:17.764210 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:17.769867 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:17.770711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:17.770793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:17.771502 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:17.771957 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:17.772383 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:17.939346 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:18.154688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:18.166141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0e75105d-4036-43a8-9a03-96521dbc3ea5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.423882 Sep 22 17:09:18.167017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 130/265] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:17 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:18.174477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:18.178350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bc05d6c9-e156-464b-80f9-dfad9df6a602 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.422714 Sep 22 17:09:18.179289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 136/266] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:17 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:18.418046 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-0a73d8a8-8b18-4458-bb4a-9bdea97815b7 req-6ee91997-6088-4677-9eae-2d3926ad4be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540ade61-fbbb-4af5-955f-df19a7a9a574", "tag": "c9288499-d369-423c-8c07-5607f6d0a2a2"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:18.439099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0a73d8a8-8b18-4458-bb4a-9bdea97815b7 req-6ee91997-6088-4677-9eae-2d3926ad4be4 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:18.440473 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0a73d8a8-8b18-4458-bb4a-9bdea97815b7 req-6ee91997-6088-4677-9eae-2d3926ad4be4 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:18.441547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0a73d8a8-8b18-4458-bb4a-9bdea97815b7 req-6ee91997-6088-4677-9eae-2d3926ad4be4 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:18.457465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-0a73d8a8-8b18-4458-bb4a-9bdea97815b7 req-6ee91997-6088-4677-9eae-2d3926ad4be4 service nova] Creating event network-changed:c9288499-d369-423c-8c07-5607f6d0a2a2 for instance 540ade61-fbbb-4af5-955f-df19a7a9a574 on hv-cinder-83538 Sep 22 17:09:18.477844 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-0a73d8a8-8b18-4458-bb4a-9bdea97815b7 req-6ee91997-6088-4677-9eae-2d3926ad4be4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054614 Sep 22 17:09:18.480238 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 131/267] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:09:19.200485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:19.201734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:19.207435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:19.207939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=48 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:19.209283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:19.209719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:19.210207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:19.210830 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:19.212135 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:19.212857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:19.213567 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:19.219309 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=8 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:19.221037 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:19.221531 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:19.222316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:19.222660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:19.223380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:19.223810 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:19.444008 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:19.461804 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4e2b963d-7df0-4450-a76a-6cd2b14ed438 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.263572 Sep 22 17:09:19.462458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 137/268] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:19 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:19.475738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:19.486445 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3e15ee54-dc0f-4bb4-9446-69a9f777d16f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.282810 Sep 22 17:09:19.487460 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 132/269] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:19 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:20.495032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:20.497947 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:20.504429 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:20.504916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:20.505354 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:20.506049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:20.506703 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:20.507419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:20.653089 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-73c3329a-943a-4cf4-879b-c0372011058c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Action: 'create', calling method: .version_select at 0x7f51d967cf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-385474825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKue4x5LBVJTC/p1dE7TzBWvaBdR9HfMFINhVDHECbeDKVdTyoC+kd+TjyVGI9UAqU4H7tIaXGv4N4pVPQbbvNilG0hhGG1tw2nDkF+4LyDqLIoBrSJBpSvHQyWsrebJAw=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:20.670389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:20.670916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-73c3329a-943a-4cf4-879b-c0372011058c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Getting quotas for project 1ed7377d32844bbf95f995831bc21d6b. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:09:20.675646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-73c3329a-943a-4cf4-879b-c0372011058c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Getting quotas for user 0365ab1bcfd54946b0b92f8fe9697128 and project 1ed7377d32844bbf95f995831bc21d6b. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:09:20.679679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-225a797a-a25a-4e37-a559-c6017692be90 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.193048 Sep 22 17:09:20.685119 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 133/270] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:20 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:20.691454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:20.692223 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:20.699769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:20.700788 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:20.701848 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:20.702765 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:20.703282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:20.703392 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-73c3329a-943a-4cf4-879b-c0372011058c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.267292 Sep 22 17:09:20.703737 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:20.704342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 138/271] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:09:20 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:09:20.857688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:20.866274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-acf5465a-5f5f-4d1f-a6d5-9cc05d822d6e tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.179979 Sep 22 17:09:20.867477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 134/272] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:20 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:21.702506 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:21.703252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:21.713352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:21.714162 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:21.714657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:21.715455 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:21.715918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:21.716347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:21.881025 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:21.890475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f36ada57-1a50-4d1c-acef-691218ee2134 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.192272 Sep 22 17:09:21.891650 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 139/273] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:21 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:21.916135 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:21.917013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:21.929026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:21.929540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:21.932139 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:21.933976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:21.936157 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:21.937047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:22.153369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:22.165390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-85ff2667-a987-4b9a-be76-876b264cbe0f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.255605 Sep 22 17:09:22.166324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 135/274] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:21 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:22.933731 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:22.934821 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:22.941593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:22.942266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:22.942861 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:22.943816 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:22.944950 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:22.945589 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:23.127359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:23.130900 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:23.141964 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-79aac23b-56ce-49d8-b65a-f5dfe8ed693d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.215299 Sep 22 17:09:23.155016 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 140/275] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:22 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:23.190015 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:23.191446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:23.198560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:23.199727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:23.200631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:23.201510 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:23.202116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:23.203274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:23.400623 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:23.416020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-514cf85f-b719-4da1-bfdc-f60b2d031751 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.230566 Sep 22 17:09:23.416623 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 136/276] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:23 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:24.169365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:24.170198 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:24.178096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:24.179024 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:24.179464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:24.180863 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:24.181313 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:24.181897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:24.363277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:24.373198 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-92b8d243-2f97-4b47-893e-4635e1e9935d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.208512 Sep 22 17:09:24.373796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 141/277] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:24 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:24.441228 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:24.441836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:24.449330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:24.449811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:24.450248 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:24.450999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:24.451421 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:24.451837 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:24.608779 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:24.619161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e61deb6e-fded-40bf-ba06-0603efdcf08b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.182989 Sep 22 17:09:24.619757 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 137/278] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:24 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:25.216821 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-e32aaaa5-9843-42ec-9f74-bced3d7feac9 req-695e02ef-19ba-49ef-9c4f-5fb5fbabbfb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540ade61-fbbb-4af5-955f-df19a7a9a574", "name": "network-vif-plugged", "status": "completed", "tag": "c9288499-d369-423c-8c07-5607f6d0a2a2"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:25.227459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e32aaaa5-9843-42ec-9f74-bced3d7feac9 req-695e02ef-19ba-49ef-9c4f-5fb5fbabbfb0 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:25.228553 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e32aaaa5-9843-42ec-9f74-bced3d7feac9 req-695e02ef-19ba-49ef-9c4f-5fb5fbabbfb0 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:25.228985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e32aaaa5-9843-42ec-9f74-bced3d7feac9 req-695e02ef-19ba-49ef-9c4f-5fb5fbabbfb0 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:25.240734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-e32aaaa5-9843-42ec-9f74-bced3d7feac9 req-695e02ef-19ba-49ef-9c4f-5fb5fbabbfb0 service nova] Creating event network-vif-plugged:c9288499-d369-423c-8c07-5607f6d0a2a2 for instance 540ade61-fbbb-4af5-955f-df19a7a9a574 on hv-cinder-83538 Sep 22 17:09:25.246725 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-e32aaaa5-9843-42ec-9f74-bced3d7feac9 req-695e02ef-19ba-49ef-9c4f-5fb5fbabbfb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033931 Sep 22 17:09:25.247462 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 142/279] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:09:25.398919 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:25.399565 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:25.405629 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:25.406160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:25.406589 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:25.407300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:25.407751 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:25.408167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:25.602907 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:25.613838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8c5b309a-067a-427a-89a7-9571d76c4549 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.218722 Sep 22 17:09:25.614514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 138/280] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:25 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:25.642279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:25.643001 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:25.649575 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:25.650053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:25.650474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:25.651211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:25.651659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:25.652075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:25.785845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:25.794267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a73bafc2-d4b2-4d51-8565-ff1ff4f132da tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.156269 Sep 22 17:09:25.795005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 143/281] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:25 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:26.637861 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:26.638760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:26.645643 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:26.646143 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:26.646583 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:26.647324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:26.647776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:26.648199 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:26.795844 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:26.804773 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-386c5b37-9a32-4f2c-9787-0987b01af601 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.171316 Sep 22 17:09:26.805822 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 139/282] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:26 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:26.818163 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:26.818897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:26.826497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:26.827114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:26.827672 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:26.828363 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:26.828811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:26.829394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:26.962679 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:26.970920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c271a60f-9eb4-48cb-989a-de12b5774006 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.157166 Sep 22 17:09:26.971530 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 144/283] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:26 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:27.831170 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:27.831727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:27.838540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:27.839063 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:27.839506 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:27.840214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:27.840670 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:27.841126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:27.975850 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:27.984488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d41ea9fb-57e8-42c6-9298-89f902f4eb78 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.157474 Sep 22 17:09:27.985080 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 140/284] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:27 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:27.996646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:27.997315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:28.005504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:28.005975 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:28.006409 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:28.007143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:28.007592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:28.008015 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:28.145289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:28.153778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f7f6b246-263c-4205-9373-b4aad5f63c99 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1313 microversion: 2.1 time: 0.161970 Sep 22 17:09:28.154502 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 145/285] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:27 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:29.007630 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:29.008744 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:29.014740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:29.015256 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:29.015694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:29.016409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:29.016851 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:29.017356 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:29.151032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:29.158653 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5cbfb7b4-2f2a-43a1-9fbc-129465e8a2e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.154904 Sep 22 17:09:29.159189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 141/286] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:29 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:29.177528 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:29.178131 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:29.184560 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:29.185043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:29.185477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:29.186160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:29.186614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:29.187124 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:29.332705 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:29.340354 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b6ecb9a8-c3ee-4c26-9e23-571e8b6ce5d4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1496 microversion: 2.1 time: 0.166967 Sep 22 17:09:29.340918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 146/287] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:29 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:30.099309 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:30.099845 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:30.107022 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:30.107503 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:30.107927 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:30.109868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:30.109868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:30.109868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:30.137420 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:09:30.181863 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:30.182479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:30.189042 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:30.189539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:30.189979 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:30.190706 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:30.191230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:30.191748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:30.220515 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4558557e-83bf-4bc4-9286-830c5f03ace5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 204 len: 0 microversion: 2.1 time: 0.124587 Sep 22 17:09:30.221322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 142/288] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:09:30 2022] DELETE /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:09:30.232459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:30.233159 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:30.239355 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:30.239848 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:30.240284 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:30.240981 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:30.241434 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:30.241856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:30.245006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:30.605611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:30.614124 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e54ddacc-ecee-40d6-8269-0d053e5dc03b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.435982 Sep 22 17:09:30.614715 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 147/289] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:30 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:30.636928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:30.644602 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b1a2e401-f876-40d0-a49f-3fe083495a48 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1502 microversion: 2.1 time: 0.418623 Sep 22 17:09:30.645157 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 143/290] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:30 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1502 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:31.638580 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:31.639245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:31.641287 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=4 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:31.646703 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:31.647224 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:31.647664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:31.648359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:31.649310 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:31.649737 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:31.669629 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:31.670404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:31.677113 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:31.677878 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:31.678382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:31.679197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:31.679677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:31.680121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:31.844782 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:31.853068 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e775985a-4b8b-490d-ae90-ea3f2df1f49e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.219276 Sep 22 17:09:31.853707 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 148/291] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:31 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:31.872698 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:31.880502 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d150f4d4-13e3-4dfc-bce6-c83289f0ad1c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1502 microversion: 2.1 time: 0.214760 Sep 22 17:09:31.881071 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 144/292] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:31 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:32.165601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1b37e966-eb3d-458d-9643-33bf360c1b03 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf07afa0-b683-46af-99ea-1df2764eeee6", "device": "/dev/sdb"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:32.168477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1b37e966-eb3d-458d-9643-33bf360c1b03 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:32.174377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b37e966-eb3d-458d-9643-33bf360c1b03 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:32.175131 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b37e966-eb3d-458d-9643-33bf360c1b03 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:32.175658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b37e966-eb3d-458d-9643-33bf360c1b03 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:32.176351 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b37e966-eb3d-458d-9643-33bf360c1b03 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:32.176806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b37e966-eb3d-458d-9643-33bf360c1b03 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:32.177397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b37e966-eb3d-458d-9643-33bf360c1b03 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:32.687360 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1b37e966-eb3d-458d-9643-33bf360c1b03 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "POST /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526181 Sep 22 17:09:32.688833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 149/293] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:09:32 2022] POST /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:09:32.877418 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:32.877991 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:32.891037 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:32.892213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:32.893043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:32.894238 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:32.894941 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:32.895397 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:32.906544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:32.907293 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:32.919088 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:32.919764 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:32.920366 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:32.921244 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:32.925478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:32.926254 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:33.088557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:33.099037 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-46828985-aa1c-458c-b9b0-346d7adca2cb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1460 microversion: 2.1 time: 0.196462 Sep 22 17:09:33.099629 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 150/294] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:32 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1460 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:33.173100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-136f211a-d2b9-40fc-a411-aad436cbe925 req-81f4ef72-622f-45f2-b86b-ca74eac47f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540ade61-fbbb-4af5-955f-df19a7a9a574", "name": "network-vif-deleted", "tag": "c9288499-d369-423c-8c07-5607f6d0a2a2"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:33.184864 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-136f211a-d2b9-40fc-a411-aad436cbe925 req-81f4ef72-622f-45f2-b86b-ca74eac47f79 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:33.185337 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-136f211a-d2b9-40fc-a411-aad436cbe925 req-81f4ef72-622f-45f2-b86b-ca74eac47f79 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:33.185943 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-136f211a-d2b9-40fc-a411-aad436cbe925 req-81f4ef72-622f-45f2-b86b-ca74eac47f79 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:33.198276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-136f211a-d2b9-40fc-a411-aad436cbe925 req-81f4ef72-622f-45f2-b86b-ca74eac47f79 service nova] Creating event network-vif-deleted:c9288499-d369-423c-8c07-5607f6d0a2a2 for instance 540ade61-fbbb-4af5-955f-df19a7a9a574 on hv-cinder-83538 Sep 22 17:09:33.203668 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-136f211a-d2b9-40fc-a411-aad436cbe925 req-81f4ef72-622f-45f2-b86b-ca74eac47f79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034329 Sep 22 17:09:33.204500 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 151/295] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:09:33.209446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:33.215881 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e2eca2a1-7eba-420a-9312-02ce5ad3f2e2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.342258 Sep 22 17:09:33.216399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 145/296] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:32 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:34.123223 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:34.124096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:34.131749 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:34.132311 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:34.132817 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:34.133695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:34.134346 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:34.135130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:34.215195 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:34.223272 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-54f2e7ec-84a0-4c83-aa70-057e671f5279 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1460 microversion: 2.1 time: 0.104979 Sep 22 17:09:34.241767 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:34.243517 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 152/297] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:34 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1460 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:34.243647 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:34.251568 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:34.252453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:34.253245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:34.254129 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:34.259209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:34.259209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:34.427336 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:34.435719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a91de6e2-077b-4e8d-9b2c-30285b30b384 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.198397 Sep 22 17:09:34.436285 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 146/298] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:34 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:35.252248 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:35.253281 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:35.262359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:35.262884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:35.263694 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:35.264560 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:35.265361 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:35.265853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:35.306890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:35.307502 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:35.308030 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:35.308594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lazy-loading 'fault' on Instance uuid 540ade61-fbbb-4af5-955f-df19a7a9a574 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:09:35.373739 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:35.382438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3a0fb127-3ae2-4bb9-b482-043a16c6714d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1303 microversion: 2.1 time: 0.134547 Sep 22 17:09:35.383147 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 153/299] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:35 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:35.458587 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:35.459231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:35.468556 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:35.469050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:35.469491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:35.470188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:35.470638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:35.471168 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:35.609613 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:35.617598 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7db8011d-d509-4080-bb58-7661490fab95 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.163387 Sep 22 17:09:35.618151 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 147/300] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:35 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:36.405219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:36.405978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:36.414345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:36.415383 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:36.415915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:36.416897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:36.417483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:36.418074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:36.456911 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:36.457395 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:36.457832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:36.458280 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lazy-loading 'fault' on Instance uuid 540ade61-fbbb-4af5-955f-df19a7a9a574 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:09:36.512538 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:36.522835 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5b9b466f-01c7-4c54-a055-1bdd589921d5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1303 microversion: 2.1 time: 0.121416 Sep 22 17:09:36.524352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 154/301] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:36 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:36.641439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:36.642149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:36.648468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:36.648935 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:36.649407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:36.650422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:36.650870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:36.651398 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:36.810237 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:36.819789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-693188cd-14a9-4370-b1f0-9dd70ff1f9d4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.182876 Sep 22 17:09:36.820373 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 148/302] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:36 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:37.549508 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:37.550381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:37.558560 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:37.559429 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:37.560025 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:37.560887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:37.561513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:37.562051 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:37.607297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:37.608041 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:37.608757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:37.609522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lazy-loading 'fault' on Instance uuid 540ade61-fbbb-4af5-955f-df19a7a9a574 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:09:37.686323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:37.699142 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7c237da7-6369-4e40-91ab-256ef4ee2201 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 200 len: 1303 microversion: 2.1 time: 0.153218 Sep 22 17:09:37.699941 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 155/303] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:37 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:37.848102 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:37.849217 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:37.857508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:37.858125 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:37.858708 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:37.859723 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:37.860396 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:37.860985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:38.020957 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:38.029878 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-486d38c1-9754-4f7e-a655-a6e088a5261a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1500 microversion: 2.1 time: 0.186893 Sep 22 17:09:38.030475 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 149/304] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:37 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1500 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:38.053056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69037ab7-66cc-43d0-a313-2fc5e049fee8"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:38.057212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:38.067192 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:38.067694 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:38.068145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:38.068861 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:38.069319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:38.069748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:38.089592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:38.099568 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] HTTP exception thrown: Cannot 'attach_volume' instance b7947f62-c48e-4f60-b109-295247f6e1aa while it is in vm_state rescued Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Request method failure captured: Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: POST /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa/os-volume_attachments HTTP/1.1 Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 74 Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZTAFlLOJ4rlDfvtbyAuZ9FrBVULX3z83mdChpvcMKbEkHMTeqCkKMuDbiHkNn6OCActvwzsE_8Ru8WCEkA81Gs5jE3Dw2LR0eZwmLDDH1jY43QhcF4N-enqNZnxT1FGdBFnYdADAdXOM3mkbqkGHXLnwDMa-jzgA_ra6k4l1Dg8N8 Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:09:38.099806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_105c11557b6f45329dc97af01e8ea915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: bc8c2a5413c943ed94d76eceb2720f17 Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {"volumeAttachment": {"volumeId": "69037ab7-66cc-43d0-a313-2fc5e049fee8"}} Sep 22 17:09:38.101435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Cannot 'attach_volume' instance b7947f62-c48e-4f60-b109-295247f6e1aa while it is in vm_state rescued Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'server_id': 'b7947f62-c48e-4f60-b109-295247f6e1aa', 'body': {'volumeAttachment': {'volumeId': '69037ab7-66cc-43d0-a313-2fc5e049fee8'}}} Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b7947f62-c48e-4f60-b109-295247f6e1aa in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:09:38.102394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b7947f62-c48e-4f60-b109-295247f6e1aa while it is in vm_state rescued Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:09:38.103798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:09:38.105094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:09:38.105094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:09:38.105094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b7947f62-c48e-4f60-b109-295247f6e1aa while it is in vm_state rescued Sep 22 17:09:38.105094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.105094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Returning 409 to user: Cannot 'attach_volume' instance b7947f62-c48e-4f60-b109-295247f6e1aa while it is in vm_state rescued {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:09:38.105094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0a349c70-2868-4191-ab72-b8263bcb48e8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052775 Sep 22 17:09:38.105094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 156/305] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:09:38 2022] POST /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 22 17:09:38.110825 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-75607761-bf5f-4a08-96e2-aceb647d6a40 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:38.111912 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-75607761-bf5f-4a08-96e2-aceb647d6a40 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:38.117711 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75607761-bf5f-4a08-96e2-aceb647d6a40 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:38.118258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75607761-bf5f-4a08-96e2-aceb647d6a40 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:38.118894 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75607761-bf5f-4a08-96e2-aceb647d6a40 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:38.119945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75607761-bf5f-4a08-96e2-aceb647d6a40 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:38.120399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75607761-bf5f-4a08-96e2-aceb647d6a40 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:38.120820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75607761-bf5f-4a08-96e2-aceb647d6a40 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:38.199819 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-75607761-bf5f-4a08-96e2-aceb647d6a40 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa/action" status: 202 len: 0 microversion: 2.1 time: 0.093137 Sep 22 17:09:38.200450 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 150/306] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:09:38 2022] POST /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:09:38.209872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:38.210691 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:38.219364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:38.219982 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:38.220616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:38.221577 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:38.222098 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:38.223129 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:38.471943 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:38.485910 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0251bf09-d645-4640-8808-c4cf098c2df9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1508 microversion: 2.1 time: 0.280389 Sep 22 17:09:38.486988 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 157/307] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:38 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:38.723369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:38.724073 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: 540ade61-fbbb-4af5-955f-df19a7a9a574] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:38.731846 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:38.732328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:38.732772 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:38.733473 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:38.733918 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:38.734335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:38.749209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] HTTP exception thrown: Instance 540ade61-fbbb-4af5-955f-df19a7a9a574 could not be found. Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Request method failure captured: Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 HTTP/1.1 Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJaxV2qV5P3L2Sw_PG_L1FInlpoCUdG7xVI4Z1kPIkphXs7SBCeGUpW79QYT5JBHxH6GJCwZzraGUpQpQqrHfbwJI1BQ6-Q5yePpL4xW8UGr-Sy-bAHymCT6C3slUGLa8zCrMZ79OQWvU3VMEIPKXYXlNWKXAvxd3z9dUJufWpCnNmg Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 6c516bf5715a42cd860981f82fc58b15 Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-VolumesActionsTest-258959910 Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:09:38.750883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c516bf5715a42cd860981f82fc58b15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c516bf5715a42cd860981f82fc58b15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c516bf5715a42cd860981f82fc58b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c516bf5715a42cd860981f82fc58b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-VolumesActionsTest-258959910 Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 6c516bf5715a42cd860981f82fc58b15 Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-VolumesActionsTest-258959910 Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-VolumesActionsTest-258959910-project Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 2ad9fb3dd77d47c190e14cf504ea4d3d Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-VolumesActionsTest-258959910-project Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 540ade61-fbbb-4af5-955f-df19a7a9a574 could not be found. Sep 22 17:09:38.752681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '540ade61-fbbb-4af5-955f-df19a7a9a574'} Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540ade61-fbbb-4af5-955f-df19a7a9a574 could not be found. Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:09:38.754026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540ade61-fbbb-4af5-955f-df19a7a9a574 could not be found. Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540ade61-fbbb-4af5-955f-df19a7a9a574 could not be found. Sep 22 17:09:38.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:09:38.757555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Returning 404 to user: Instance 540ade61-fbbb-4af5-955f-df19a7a9a574 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:09:38.757555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-525e1dfb-ce89-4267-9282-07bee017422b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574" status: 404 len: 111 microversion: 2.1 time: 0.033301 Sep 22 17:09:38.757555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 151/308] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:38 2022] GET /compute/v2.1/servers/540ade61-fbbb-4af5-955f-df19a7a9a574 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:09:38.929565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-287450448", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "networks": [{"uuid": "5f2097d8-b178-40e5-9027-cc66e5236eeb"}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:38.996178 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] validate_networks() for [('5f2097d8-b178-40e5-9027-cc66e5236eeb', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:09:39.408458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:09:39.409174 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:09:39.409753 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:09:39.410450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:09:39.410853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:09:39.422222 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:39.422820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:39.423505 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:39.424402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:39.425095 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:39.425528 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:39.445245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Getting quotas for project 6c516bf5715a42cd860981f82fc58b15. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:09:39.450615 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Getting quotas for user 2ad9fb3dd77d47c190e14cf504ea4d3d and project 6c516bf5715a42cd860981f82fc58b15. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:09:39.465954 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:09:39.468416 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:09:39.510793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:39.511719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:39.515103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4f4505d4-eedc-4ae0-a027-3f08bb3309f4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589777 Sep 22 17:09:39.516276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 158/309] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 17:09:39.528383 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:39.529001 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e3fc3bb8-b904-4f86-a138-00b12b331d00 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:39.529483 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:39.529737 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e3fc3bb8-b904-4f86-a138-00b12b331d00 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:39.531342 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:39.532570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:39.533849 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:39.534492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:39.634332 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e3fc3bb8-b904-4f86-a138-00b12b331d00 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:39.646641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e3fc3bb8-b904-4f86-a138-00b12b331d00 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1213 microversion: 2.1 time: 0.122248 Sep 22 17:09:39.648477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 159/310] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:39 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:39.788802 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:39.797169 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ac48b879-0421-48d7-9a84-652c13011681 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1508 microversion: 2.1 time: 0.290911 Sep 22 17:09:39.798048 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 152/311] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:39 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:40.671872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:40.672485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:40.679199 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:40.679683 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:40.680111 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:40.681323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:40.681775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:40.682197 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:40.744864 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:40.752595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d44ef9f6-1df6-43d0-9096-bf9dbf8a022c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1217 microversion: 2.1 time: 0.084498 Sep 22 17:09:40.753162 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 160/312] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:40 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:40.825382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:40.826127 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:40.832694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:40.833254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:40.834037 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:40.834735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:40.835216 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:40.835639 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:40.994893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:41.002684 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-228a0765-59b1-4fc6-a95e-c3c7987016e0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1508 microversion: 2.1 time: 0.182299 Sep 22 17:09:41.003276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 153/313] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:40 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:41.776568 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:41.777166 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:41.783506 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:41.783986 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:41.784411 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:41.785090 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:41.785535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:41.785945 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:41.848394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:41.856571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ed97eb49-ec7a-4e00-8691-1ab43908ab66 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1217 microversion: 2.1 time: 0.083831 Sep 22 17:09:41.857139 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 161/314] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:41 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:42.026314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:42.026853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:42.032916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:42.033434 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:42.033928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:42.034607 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:42.035089 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:42.035509 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:42.165544 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:42.173641 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-eb6ff266-5a5f-4db9-856b-e9f0c9e13587 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1508 microversion: 2.1 time: 0.151696 Sep 22 17:09:42.174203 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 154/315] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:42 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:42.879945 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:42.880583 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:42.887675 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:42.888158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:42.888619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:42.889307 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:42.889757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:42.890181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:42.951301 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:42.959536 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e4d4c79f-3943-43d6-9470-411ef9277bd8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1209 microversion: 2.1 time: 0.083503 Sep 22 17:09:42.960092 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 162/316] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:42 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:43.201655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:43.203997 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:43.215736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:43.216931 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:43.217744 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:43.218962 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:43.219748 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:43.220517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:43.386608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:43.394403 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-74fbe3ce-a47f-4910-b356-8462d2b1a50b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1514 microversion: 2.1 time: 0.200758 Sep 22 17:09:43.394977 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 155/317] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:43 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:09:43.982865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:43.983525 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:43.991874 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:43.992541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:43.994471 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:43.995525 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:43.996010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:43.996442 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:44.061454 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:44.069004 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0188789d-3815-4111-88fb-f732e5fc603d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1265 microversion: 2.1 time: 0.090692 Sep 22 17:09:44.069569 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 163/318] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:43 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:45.090824 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:45.091559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:45.093456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:45.098820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:45.099340 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:45.099800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:45.100467 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:45.100918 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:45.101343 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:45.163901 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:45.171585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6f5e3816-b70f-4ba1-8924-63a423a24ebe tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1271 microversion: 2.1 time: 0.084699 Sep 22 17:09:45.172149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 156/319] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:45 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:46.194924 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:46.195582 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:46.202651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:46.203182 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:46.203621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:46.204325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:46.204928 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:46.205246 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:46.269190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:46.277815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d1a77c93-9f32-4d5f-b67f-741cedd4b36f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1271 microversion: 2.1 time: 0.086984 Sep 22 17:09:46.278609 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 164/320] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:46 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:47.300949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:47.301830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:47.307877 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:47.308352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:47.308777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:47.309458 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:47.309900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:47.310321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:47.372547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:47.381521 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d4d74a7d-ae24-455c-a8be-c0b9ffcc247d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1271 microversion: 2.1 time: 0.084589 Sep 22 17:09:47.382101 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 157/321] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:47 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:48.405947 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:48.406311 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:48.413125 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:48.413637 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:48.414064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:48.414763 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:48.415254 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:48.416219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:48.489512 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:48.498122 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7a5886ba-159e-4342-b2f2-b19b2aa879b8 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1271 microversion: 2.1 time: 0.097139 Sep 22 17:09:48.498695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 165/322] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:48 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:49.523132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:49.524215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:49.531463 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:49.531964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:49.532401 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:49.533093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:49.533545 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:49.534157 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:49.666549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:49.674462 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-be2182f0-a2d7-42b2-804e-cd892ccbefae tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.157342 Sep 22 17:09:49.675319 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 158/323] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:49 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:50.701593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:50.702184 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:50.704651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:50.705421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=8 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:50.706129 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:50.712855 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:50.713337 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:50.713761 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:50.714459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:50.714989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:50.715406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:50.978936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:50.987635 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6ce687b3-a5d8-42dc-a595-1b4fec958567 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.290070 Sep 22 17:09:50.988390 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 166/324] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:50 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:51.184094 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-9eed21f6-fb42-4b4d-bd79-ae98b418b48d req-e6e5ae6f-f8d4-4ee6-9f6d-1244b8c1395a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c1c162-44d4-4441-8009-032e602e9418", "tag": "7c1dd24d-7949-4eb9-8891-ea0b4a095c46"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:51.198165 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-9eed21f6-fb42-4b4d-bd79-ae98b418b48d req-e6e5ae6f-f8d4-4ee6-9f6d-1244b8c1395a service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:51.198870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-9eed21f6-fb42-4b4d-bd79-ae98b418b48d req-e6e5ae6f-f8d4-4ee6-9f6d-1244b8c1395a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:51.200232 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-9eed21f6-fb42-4b4d-bd79-ae98b418b48d req-e6e5ae6f-f8d4-4ee6-9f6d-1244b8c1395a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:51.215956 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-9eed21f6-fb42-4b4d-bd79-ae98b418b48d req-e6e5ae6f-f8d4-4ee6-9f6d-1244b8c1395a service nova] Creating event network-changed:7c1dd24d-7949-4eb9-8891-ea0b4a095c46 for instance a7c1c162-44d4-4441-8009-032e602e9418 on hv-cinder-83538 Sep 22 17:09:51.222389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-9eed21f6-fb42-4b4d-bd79-ae98b418b48d req-e6e5ae6f-f8d4-4ee6-9f6d-1244b8c1395a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042835 Sep 22 17:09:51.223644 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 159/325] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:09:52.012994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:52.013601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:52.021898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:52.022307 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:52.022735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:52.023449 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:52.023904 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:52.024324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:52.152305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:52.162079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1c674116-4447-4d22-8bcf-d3b668b28142 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.153506 Sep 22 17:09:52.162633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 167/326] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:52 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:53.185756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:53.186439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:53.192464 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:53.192936 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:53.193367 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:53.194042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:53.194492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:53.194913 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:53.198602 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:09:53.565961 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:53.574265 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c9506e2c-401f-4336-937d-4421db4645a4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.392613 Sep 22 17:09:53.574829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 160/327] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:53 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:54.596768 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:54.597408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:54.603809 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:54.604294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:54.604750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:54.605438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:54.605891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:54.606318 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:54.744822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:54.752905 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d9b36f60-5a17-41de-b62b-d4a8634c2ca4 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.159860 Sep 22 17:09:54.754870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 168/328] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:54 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:55.776784 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:55.777418 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:55.783379 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:55.783859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:55.784293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:55.784982 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:55.785429 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:55.785848 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:55.920232 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:55.933089 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-13e8206f-5250-48e2-9b3a-aad3c1029fcb tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.160610 Sep 22 17:09:55.933681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 161/329] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:55 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:56.957688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:56.958329 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:56.964708 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:56.965190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:56.965624 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:56.966316 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:56.966773 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:56.967223 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:57.097270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:57.105730 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-290e3474-896a-4ae7-8078-7dc588d64278 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.151960 Sep 22 17:09:57.106426 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 169/330] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:56 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:58.128793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:58.129324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:58.135724 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:58.136226 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:58.136650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:58.137320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:58.137764 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:58.138172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:58.265499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:58.273296 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c5bfd0a3-4d9d-42c1-b0e9-0a919cca9057 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.148583 Sep 22 17:09:58.273850 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 162/331] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:58 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:58.502198 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-09bafd63-065f-4e3d-a521-fd4322c005c9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'create', calling method: .version_select at 0x7f51d97a9700>, body: {"keypair": {"name": "tempest-keypair-957986194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn6UsFhIfNeMLB4y2ebYfTbHSK/+S0L2t66Fq5JAQNMfVaXCt7GsIzTsmqDpsOi48tAVwfKbgNiUPx5JexFNKZHIsNvjajAd7NQjESlAS978LM3LFLdCzux2Ub1j2J2bw=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:58.517540 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-09bafd63-065f-4e3d-a521-fd4322c005c9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Getting quotas for project 105c11557b6f45329dc97af01e8ea915. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:09:58.521284 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-09bafd63-065f-4e3d-a521-fd4322c005c9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Getting quotas for user bc8c2a5413c943ed94d76eceb2720f17 and project 105c11557b6f45329dc97af01e8ea915. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:09:58.543571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-09bafd63-065f-4e3d-a521-fd4322c005c9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045035 Sep 22 17:09:58.544171 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 170/332] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:09:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:09:59.297733 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:09:59.298540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:09:59.307155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:59.307630 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:59.308121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:59.309025 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:09:59.309555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:09:59.310078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:09:59.456131 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:09:59.464147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6621f425-d18a-4ab2-a5a9-d8eae1aec1c6 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.171658 Sep 22 17:09:59.464720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 163/333] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:09:59 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:09:59.839859 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-450193103", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "906da010-9d01-428f-8bbf-d862e44df893"}], "security_groups": [{"name": "tempest-securitygroup--1093841424"}], "key_name": "tempest-keypair-957986194", "user_data": "}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:09:59.943057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] validate_networks() for [('906da010-9d01-428f-8bbf-d862e44df893', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:10:00.327370 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:10:00.327800 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:10:00.328271 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:10:00.328682 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:10:00.329095 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:10:00.338113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:00.338595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:00.339064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:00.339792 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:00.340247 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:00.340702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:00.357513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Getting quotas for project 105c11557b6f45329dc97af01e8ea915. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:10:00.361247 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Getting quotas for user bc8c2a5413c943ed94d76eceb2720f17 and project 105c11557b6f45329dc97af01e8ea915. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:10:00.372518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:10:00.374701 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:10:00.423336 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a5b02c8e-7055-4457-a3c5-1f4d74aa6508 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.588981 Sep 22 17:10:00.424025 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 171/334] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:09:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:10:00.436932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bcd163e7-3202-4cc8-a99f-7cf760ad7bf0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:00.437530 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-bcd163e7-3202-4cc8-a99f-7cf760ad7bf0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:00.487068 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:00.488323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:00.494696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bcd163e7-3202-4cc8-a99f-7cf760ad7bf0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:00.494906 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:00.495519 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:00.496011 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:00.496783 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:00.497450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:00.497878 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:00.502169 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bcd163e7-3202-4cc8-a99f-7cf760ad7bf0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1244 microversion: 2.1 time: 0.068972 Sep 22 17:10:00.502730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 164/335] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:00 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1244 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:00.631853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:00.640137 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ea102530-12a5-4eaf-b09c-c249c760f1c5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.157640 Sep 22 17:10:00.640706 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 172/336] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:00 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:01.525405 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:01.526008 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:01.531927 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:01.532406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:01.532845 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:01.533527 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:01.533980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:01.534401 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:01.595052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:01.602559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-aad9008b-46fc-4beb-9bba-0546a7f81735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.081593 Sep 22 17:10:01.603152 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 165/337] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:01 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:01.662871 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:01.663505 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:01.669890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:01.670370 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:01.670804 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:01.671588 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:01.671979 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:01.672398 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:01.804822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:01.813616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-54b7a540-244b-47be-9333-881070ab41ee tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.154699 Sep 22 17:10:01.814184 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 173/338] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:01 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:02.625224 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:02.625835 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:02.631939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:02.632421 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:02.632854 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:02.634021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:02.634471 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:02.634892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:02.703672 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:02.711439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d81e22e7-1d7e-4e04-8184-5c6137177b7a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.089993 Sep 22 17:10:02.712606 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 166/339] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:02 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:02.837541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:02.838318 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:02.844772 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:02.845251 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:02.845682 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:02.846363 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:02.846809 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:02.847258 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:02.984379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:02.993164 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-24c941ad-5124-4113-bff8-89fa647c80f9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.159753 Sep 22 17:10:02.993786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 174/340] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:02 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:03.735048 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:03.735597 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:03.741559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:03.742045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:03.742482 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:03.743880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:03.744335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:03.744762 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:03.813457 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:03.821168 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5edb5dcb-e52f-41f6-9f03-a7ff1f754c11 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.090095 Sep 22 17:10:03.821735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 167/341] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:03 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:04.016002 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:04.016544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:04.022936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:04.023483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:04.023923 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:04.025118 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:04.025571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:04.026004 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:04.156379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:04.164023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-24ff924b-eb75-4f46-8c93-5bc466672ced tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.151989 Sep 22 17:10:04.164580 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 175/342] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:04 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:04.843785 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:04.844403 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:04.850303 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:04.850772 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:04.851231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:04.851904 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:04.852460 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:04.852990 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:04.915480 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:04.923115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9e40513f-187b-40d5-a151-c38c48f6750f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.083162 Sep 22 17:10:04.923683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 168/343] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:04 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:05.187590 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:05.188257 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:05.194688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:05.195271 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:05.195832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:05.196595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:05.197110 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:05.197612 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:05.336504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:05.340537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:05.345484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cb78157f-743e-4eaa-b113-f9f9f54ebde0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.161833 Sep 22 17:10:05.346056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 176/344] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:05 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:05.945485 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:05.946589 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:05.952500 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:05.952974 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:05.953409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:05.954085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:05.954526 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:05.954980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:06.015177 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:06.022603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d7effe7c-ede1-490d-bbcb-35a8014559ee tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.080849 Sep 22 17:10:06.023133 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 169/345] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:05 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:06.369377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:06.369990 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:06.376372 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:06.376859 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:06.377295 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:06.377989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:06.378447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:06.378968 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:06.513159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:06.520715 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7545cdb5-06fa-46f7-9a79-7c9e7dcbda22 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.155938 Sep 22 17:10:06.521276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 177/346] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:06 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:07.045723 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:07.046360 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:07.052640 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:07.053124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:07.053560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:07.054246 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:07.054700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:07.055185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:07.117724 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:07.126004 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-08d7a544-4018-4a56-bfa3-ae764e7e0f53 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.084139 Sep 22 17:10:07.126643 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 170/347] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:07 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:07.543930 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:07.544533 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:07.551291 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:07.551714 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:07.552148 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:07.552838 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:07.553290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:07.553713 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:07.685478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:07.693103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1d4f67a1-9bf2-4d83-8ffe-d104e552caec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.153819 Sep 22 17:10:07.693662 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 178/348] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:07 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:08.151256 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:08.151818 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:08.159175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:08.159690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:08.160504 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:08.161782 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:08.162318 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:08.163182 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:08.244400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:08.252560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9aa70bfc-1b70-4082-80c5-da817c566096 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.106041 Sep 22 17:10:08.253245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 171/349] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:08 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:08.716647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:08.717265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:08.723971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:08.724456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:08.724888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:08.725575 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:08.726038 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:08.726461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:08.860749 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:08.869467 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d198563a-e922-4442-9d9c-fe6256a5ca6f tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.156668 Sep 22 17:10:08.870164 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 179/350] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:08 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:09.281509 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:09.282116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:09.288070 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:09.288548 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:09.289035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:09.290372 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:09.290817 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:09.291254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:09.354865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:09.363789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8f02b7b2-2440-44d5-b616-1892c155c8f2 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.085976 Sep 22 17:10:09.374985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 172/351] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:09 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:09.892659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:09.893169 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:09.899579 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:09.900062 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:09.900496 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:09.901241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:09.901641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:09.902063 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:10.032263 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:10.039885 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-af423603-8c22-4d4e-8c51-637636e2c591 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.151344 Sep 22 17:10:10.040450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 180/352] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:09 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:10.386721 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:10.388129 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:10.394027 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:10.394509 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:10.394937 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:10.395653 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:10.396072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:10.396489 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:10.465814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:10.473505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-029afb5f-5938-4925-84f4-0df82af15cdf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.091085 Sep 22 17:10:10.474064 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 173/353] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:10 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:11.062546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:11.063183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:11.065009 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:11.065659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=10 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:11.071915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:11.072396 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:11.072826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:11.073517 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:11.073965 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:11.074382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:11.200923 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:11.208474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-30eca7a3-3ee4-4258-a0a3-7c6221f3366d tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.149780 Sep 22 17:10:11.209037 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 181/354] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:11 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:11.496459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:11.497174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:11.497634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1198806858", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-385474825", "security_groups": [{"name": "tempest-secgroup-smoke-163434752"}], "networks": [{"uuid": "76fdfd82-e2ca-4e82-8d26-41a9f16c8858"}], "block_device_mapping_v2": [{"uuid": "0e14ed87-c8d3-4e2e-b9e4-2c3c57f56e42", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:11.499168 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:11.504749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:11.505297 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:11.505828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:11.506516 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:11.506986 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:11.507411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:11.571750 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:11.579852 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b1ccf5cc-3fe9-4817-8b46-83e3701ffbc6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.087178 Sep 22 17:10:11.580426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 174/355] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:11 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:11.614118 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] validate_networks() for [('76fdfd82-e2ca-4e82-8d26-41a9f16c8858', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:10:11.987043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:10:11.987533 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:10:11.988392 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:10:11.988794 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:10:11.989201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:10:11.998398 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:11.998865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:11.999324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:12.000032 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:12.000474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:12.000891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:12.016838 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Getting quotas for project 1ed7377d32844bbf95f995831bc21d6b. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:10:12.020514 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Getting quotas for user 0365ab1bcfd54946b0b92f8fe9697128 and project 1ed7377d32844bbf95f995831bc21d6b. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:10:12.077580 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:10:12.079708 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e14ed87-c8d3-4e2e-b9e4-2c3c57f56e42',volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:10:12.205231 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f0837853-72b4-4493-af84-a5acea6762ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.711365 Sep 22 17:10:12.205866 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 182/356] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:10:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 17:10:12.217001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7ca6033d-9b7f-41b3-968a-bbb3c9eef607 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:12.217699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7ca6033d-9b7f-41b3-968a-bbb3c9eef607 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:12.232478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:12.233431 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:12.240637 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:12.241132 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:12.241561 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:12.242251 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:12.242694 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:12.243146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:12.279747 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7ca6033d-9b7f-41b3-968a-bbb3c9eef607 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:12.286603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7ca6033d-9b7f-41b3-968a-bbb3c9eef607 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1088 microversion: 2.1 time: 0.073467 Sep 22 17:10:12.287198 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 175/357] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:12 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:12.391539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:12.399213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ec5e16bf-c86a-4bc9-b74c-d5c85a276381 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.171050 Sep 22 17:10:12.399782 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 183/358] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:12 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:12.603492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:12.604109 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:12.610823 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:12.611353 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:12.611809 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:12.612494 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:12.612952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:12.613476 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:12.673945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:12.681787 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a2a9db87-d170-4459-a5ac-9c809232f1ab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.082578 Sep 22 17:10:12.682392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 176/359] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:12 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:13.310899 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:13.311526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:13.317890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:13.318362 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:13.318785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:13.319481 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:13.319927 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:13.320338 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:13.379580 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:13.387793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-25556a0f-44b3-4e68-ac56-3177c8283935 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1138 microversion: 2.1 time: 0.081254 Sep 22 17:10:13.388352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 184/360] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:13 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:13.423821 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:13.424455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:13.430563 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:13.431066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:13.431492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:13.432221 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:13.432687 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:13.433103 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:13.564131 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:13.571752 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1d08ea4c-99e2-4421-a87f-26d46fa82d73 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.151658 Sep 22 17:10:13.572317 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 177/361] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:13 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:13.704067 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:13.704669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:13.710663 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:13.711176 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:13.711606 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:13.712284 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:13.712729 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:13.713144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:13.773048 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:13.783755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-83e8ac56-8ef3-4d0a-8656-606ce707abab tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.083442 Sep 22 17:10:13.784335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 185/362] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:13 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:14.410636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:14.411344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:14.417783 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:14.418255 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:14.418678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:14.419385 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:14.419828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:14.420241 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:14.478680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:14.481409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:14.488658 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b10d1ee5-a344-43d0-8b19-b976afb9f7be tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1138 microversion: 2.1 time: 0.081782 Sep 22 17:10:14.489215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 178/363] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:14 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:14.594699 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:14.595340 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:14.601387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:14.601863 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:14.602294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:14.602994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:14.603447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:14.603867 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:14.735477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:14.743177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-138ddbb7-6909-419b-9ce9-abda49628b5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.152270 Sep 22 17:10:14.743751 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 186/364] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:14 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:14.806399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:14.807032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:14.812967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:14.813447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:14.813882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:14.814564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:14.815045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:14.815469 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:14.875589 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:14.883163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fccc93b6-7e5d-48b7-b2ec-4c10995925d5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.081016 Sep 22 17:10:14.883729 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 179/365] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:14 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:15.512797 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:15.513407 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:15.519517 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:15.520002 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:15.520425 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:15.521124 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:15.521574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:15.521998 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:15.596479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:15.604668 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4b972b4d-463e-4c76-b75e-8c1d6b1af8a2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1138 microversion: 2.1 time: 0.096454 Sep 22 17:10:15.605251 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 187/366] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:15 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1138 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:15.770093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:15.770701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:15.772603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=52 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:15.777753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:15.778241 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:15.778670 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:15.779434 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:15.779844 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:15.780263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:15.905769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:15.906454 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:15.911412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:15.912718 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:15.913234 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:15.913735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:15.914532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:15.915079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:15.915522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:15.919445 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fd5cfe59-42e6-4c08-ae0d-d17a2e32f971 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.153259 Sep 22 17:10:15.920019 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 180/367] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:15 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:15.978101 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:15.986353 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f3badcf3-102f-41dd-bc3f-b1eaa3452caa tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1248 microversion: 2.1 time: 0.084632 Sep 22 17:10:15.986963 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 188/368] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:15 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:16.630116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:16.631092 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:16.638038 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:16.638814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:16.639399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:16.640156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:16.640678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:16.641223 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:16.731942 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:16.740337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7dd6286b-2a67-4b98-8ba5-8557d1e91b7c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1186 microversion: 2.1 time: 0.115056 Sep 22 17:10:16.745472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 181/369] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:16 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1186 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:16.942653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:16.943307 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:16.950049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:16.950587 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:16.950971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:16.951664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:16.952108 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:16.952523 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:17.011192 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:17.011587 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:17.017811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:17.018388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:17.018897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:17.019822 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:17.020342 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:17.020880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:17.094141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:17.102415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d1c6e0ce-c8ff-4601-bf0d-9cc0c6ef162d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1240 microversion: 2.1 time: 0.096600 Sep 22 17:10:17.103311 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 182/370] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:17 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:17.116458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:17.124894 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a8afaf5a-30d8-43e2-9512-f7d291a31852 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.185938 Sep 22 17:10:17.125477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 189/371] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:16 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:17.765809 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:17.766456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:17.772484 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:17.772966 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:17.773407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:17.774094 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:17.774546 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:17.774989 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:17.841358 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:17.849198 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5e7407be-f175-41b4-974f-2fd98d3a8981 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1186 microversion: 2.1 time: 0.087287 Sep 22 17:10:17.849755 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 183/372] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:17 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:18.126562 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:18.127227 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:18.133554 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:18.134296 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:18.134727 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:18.135970 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:18.136404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:18.136823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:18.148296 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:18.148903 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:18.155409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:18.155888 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:18.156347 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:18.157035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:18.157491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:18.157913 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:18.208564 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:18.217053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e5ef732b-853f-4f39-969b-e8c3e0fef07c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1240 microversion: 2.1 time: 0.094925 Sep 22 17:10:18.217628 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 190/373] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:18 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:18.368945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:18.376940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e9e0cfce-e59d-448e-a231-c426d0825282 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.232424 Sep 22 17:10:18.377498 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 184/374] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:18 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:18.872960 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:18.873600 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:18.879567 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:18.880045 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:18.880478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:18.881161 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:18.881613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:18.882038 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:18.943034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:18.950624 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9d2537e2-b088-4bf7-9c16-d4ceb297a3d2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1186 microversion: 2.1 time: 0.082231 Sep 22 17:10:18.951216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 191/375] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:18 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:19.239387 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:19.240024 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:19.245986 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:19.246465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:19.246896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:19.247679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:19.248125 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:19.248543 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:19.309454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:19.317026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8454b81b-3972-4384-8844-e4630fe5ee44 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1240 microversion: 2.1 time: 0.081465 Sep 22 17:10:19.317589 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 185/376] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:19 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:19.400417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:19.401496 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:19.407840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:19.408321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:19.408755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:19.409449 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:19.409901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:19.410324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:19.542082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:19.550084 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-be584945-ac7e-4318-95e6-ace95bc07b34 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.153501 Sep 22 17:10:19.550650 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 192/377] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:19 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:19.973094 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:19.973694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:19.979582 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:19.980054 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:19.980477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:19.981159 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:19.981604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:19.982013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:20.042432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:20.050360 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fa931466-86c9-44a0-8a49-0004ed29ed75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1186 microversion: 2.1 time: 0.081141 Sep 22 17:10:20.050912 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 186/378] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:19 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1186 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:20.341416 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:20.341950 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:20.347937 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:20.348421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:20.348854 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:20.349547 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:20.349998 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:20.350423 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:20.409888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:20.417934 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4700a151-b99c-4967-a005-c6bec2509b31 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1240 microversion: 2.1 time: 0.081589 Sep 22 17:10:20.418495 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 193/379] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:20 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:20.573937 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:20.574566 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:20.580504 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:20.580978 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:20.581426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:20.582972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:20.583441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:20.584221 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:20.723521 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:20.731801 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cd8e13ef-6405-41f4-a198-2f1487786c5b tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.162572 Sep 22 17:10:20.732363 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 187/380] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:20 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:21.074138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:21.074734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:21.076585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:21.082071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:21.082541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:21.082989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:21.083723 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:21.084163 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:21.084601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:21.089649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:21.146064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:21.154289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a48fb88f-c262-4eb2-98dd-aa555b521414 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1186 microversion: 2.1 time: 0.084585 Sep 22 17:10:21.155133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 194/381] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:21 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:21.441468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:21.442122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:21.448804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:21.449284 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:21.449720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:21.450404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:21.450858 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:21.451308 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:21.514002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:21.521684 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-42269d1f-60bd-41dd-9b7a-839335a04fb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1240 microversion: 2.1 time: 0.084011 Sep 22 17:10:21.522249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 188/382] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:21 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:21.755133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:21.755688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:21.762290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:21.762779 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:21.763238 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:21.764014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:21.764496 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:21.764980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:21.920183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:21.929290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a9c9dbe8-7ac0-4028-9dc9-bc412bc783a9 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.177346 Sep 22 17:10:21.930564 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 195/383] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:21 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:22.178075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:22.178682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:22.188244 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:22.188781 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:22.189216 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:22.189902 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:22.190349 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:22.190763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:22.283845 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:22.294665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:22.305715 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-45997661-7cbb-4114-bf39-e889a3a7e232 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1204 microversion: 2.1 time: 0.131902 Sep 22 17:10:22.306690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 189/384] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:22 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1204 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:22.548138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:22.548953 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:22.563921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:22.564806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:22.566701 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:22.567224 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:22.568537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:22.569679 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:22.570360 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:22.572228 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:22.601060 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-997c860c-926a-4a35-8c63-7d91a1f5713e req-ef9d89ae-29c4-4b00-95aa-f5cfdbd7e696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c1c162-44d4-4441-8009-032e602e9418", "name": "network-vif-plugged", "status": "completed", "tag": "7c1dd24d-7949-4eb9-8891-ea0b4a095c46"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:22.616974 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-997c860c-926a-4a35-8c63-7d91a1f5713e req-ef9d89ae-29c4-4b00-95aa-f5cfdbd7e696 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:22.631735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-997c860c-926a-4a35-8c63-7d91a1f5713e req-ef9d89ae-29c4-4b00-95aa-f5cfdbd7e696 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:22.632183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-997c860c-926a-4a35-8c63-7d91a1f5713e req-ef9d89ae-29c4-4b00-95aa-f5cfdbd7e696 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:22.645013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-997c860c-926a-4a35-8c63-7d91a1f5713e req-ef9d89ae-29c4-4b00-95aa-f5cfdbd7e696 service nova] Creating event network-vif-plugged:7c1dd24d-7949-4eb9-8891-ea0b4a095c46 for instance a7c1c162-44d4-4441-8009-032e602e9418 on hv-cinder-83538 Sep 22 17:10:22.651650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-997c860c-926a-4a35-8c63-7d91a1f5713e req-ef9d89ae-29c4-4b00-95aa-f5cfdbd7e696 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054490 Sep 22 17:10:22.653042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 190/385] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:10:22.703588 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:22.711657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9df8f4c4-cf27-4b82-ac61-9a9716613d2a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1296 microversion: 2.1 time: 0.170184 Sep 22 17:10:22.719028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 196/386] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:22 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:22.953620 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:22.954356 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:22.960909 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:22.961419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:22.961871 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:22.962766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:22.963805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:22.964361 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:23.273550 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:23.288815 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d0c1e74f-5ab2-40a5-8f49-c0b4e15b6ac5 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.339471 Sep 22 17:10:23.289621 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 191/387] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:22 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:23.336846 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:23.337462 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:23.345729 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:23.346574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:23.347376 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:23.348490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:23.349084 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:23.349979 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:23.737036 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:23.737677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:23.747194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:23.754006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:23.759850 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:23.760993 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:23.761396 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a36f706b-04de-405a-88ce-15cefe36d5e9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1271 microversion: 2.1 time: 0.426076 Sep 22 17:10:23.762419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 197/388] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:23 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1271 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:23.763586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:23.764430 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:23.765109 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:24.006831 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:24.015057 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7d9a3b66-3fde-43dc-b99c-94f5b0e8b594 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1302 microversion: 2.1 time: 0.282656 Sep 22 17:10:24.015843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 192/389] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:23 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1302 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:24.221555 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-0bf64e5a-f6c1-47a5-bc2d-4fc4bdd2faae req-a31aacca-94ca-4d98-b3f4-bf72f5cae58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e671ca-5873-4190-9048-a875393d1055", "tag": "bfa945c1-4510-4653-9180-db1133adbc18"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:24.231481 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-0bf64e5a-f6c1-47a5-bc2d-4fc4bdd2faae req-a31aacca-94ca-4d98-b3f4-bf72f5cae58b service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:24.231889 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-0bf64e5a-f6c1-47a5-bc2d-4fc4bdd2faae req-a31aacca-94ca-4d98-b3f4-bf72f5cae58b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:24.232321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-0bf64e5a-f6c1-47a5-bc2d-4fc4bdd2faae req-a31aacca-94ca-4d98-b3f4-bf72f5cae58b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:24.243663 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-0bf64e5a-f6c1-47a5-bc2d-4fc4bdd2faae req-a31aacca-94ca-4d98-b3f4-bf72f5cae58b service nova] Creating event network-changed:bfa945c1-4510-4653-9180-db1133adbc18 for instance 60e671ca-5873-4190-9048-a875393d1055 on hv-cinder-83538 Sep 22 17:10:24.249929 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-0bf64e5a-f6c1-47a5-bc2d-4fc4bdd2faae req-a31aacca-94ca-4d98-b3f4-bf72f5cae58b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032082 Sep 22 17:10:24.250630 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 198/390] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:10:24.313139 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:24.313766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:24.319981 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:24.320597 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:24.321037 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:24.321761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:24.322214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:24.322770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:24.463690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:24.471427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-93eae776-f566-45c3-a451-af7f60e60ed0 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.162377 Sep 22 17:10:24.471981 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 193/391] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:24 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:24.794624 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:24.795931 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:24.804581 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:24.805298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:24.806014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:24.806868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:24.808208 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:24.808633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:25.006341 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:25.014882 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e800feab-4341-49dc-a00f-b01b3590a330 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.229603 Sep 22 17:10:25.015591 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 199/392] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:24 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:25.037839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:25.038543 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:25.044908 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:25.045413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:25.045923 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:25.046626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:25.047137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:25.047565 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:25.137105 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:25.144975 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f0217684-34a4-4321-8be9-798e285ffb25 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1302 microversion: 2.1 time: 0.111127 Sep 22 17:10:25.145537 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 194/393] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:25 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:25.496715 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:25.497322 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:25.503480 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:25.503992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:25.504421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:25.505114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:25.505558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:25.505975 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:25.673658 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:25.674320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:25.680756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:25.681250 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:25.682441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:25.683184 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:25.683635 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:25.684042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:25.798596 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:25.809403 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-46389767-191f-4fe4-911c-648cd7b02304 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1313 microversion: 2.1 time: 0.317186 Sep 22 17:10:25.810635 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 200/394] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:25 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:25.819456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lazy-loading 'services' on Instance uuid 34975170-3fed-4365-af86-d8375013ad5c {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:10:25.857602 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:25.946867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5b21417e-bf8a-4d12-a8f4-840520190b93 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c/os-volume_attachments/bf07afa0-b683-46af-99ea-1df2764eeee6" status: 202 len: 0 microversion: 2.1 time: 0.276846 Sep 22 17:10:25.947808 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 195/395] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:10:25 2022] DELETE /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c/os-volume_attachments/bf07afa0-b683-46af-99ea-1df2764eeee6 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 17:10:26.037951 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:26.038738 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:26.046649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:26.047529 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:26.048181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:26.049086 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:26.050190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:26.050804 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:26.168562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:26.169764 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:26.176744 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:26.177588 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:26.178154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:26.178868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:26.179426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:26.180016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:26.384149 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:26.395851 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-42ace1ab-6362-4f39-9aac-8ff9afd9d2e1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.361913 Sep 22 17:10:26.397086 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 201/396] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:26 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:26.556291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:26.565952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0df95449-a199-4bab-af03-e4514e5fb3f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.401777 Sep 22 17:10:26.566740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 196/397] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:26 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:26.833397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:26.834012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:26.841811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:26.842319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:26.842981 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:26.843908 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:26.844544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:26.845113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:26.862249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-0298f162-9048-48aa-8d5e-9864f9df97f2 req-bd75695b-15ef-405c-a08d-aaa7e7a3735e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273ac187-4613-4832-a9a4-4cf53828d55f", "tag": "f2393791-4dcd-48e5-ab8f-65b3058fd17e"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:26.876747 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0298f162-9048-48aa-8d5e-9864f9df97f2 req-bd75695b-15ef-405c-a08d-aaa7e7a3735e service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:26.877446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0298f162-9048-48aa-8d5e-9864f9df97f2 req-bd75695b-15ef-405c-a08d-aaa7e7a3735e service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:26.878042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0298f162-9048-48aa-8d5e-9864f9df97f2 req-bd75695b-15ef-405c-a08d-aaa7e7a3735e service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:26.893999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-0298f162-9048-48aa-8d5e-9864f9df97f2 req-bd75695b-15ef-405c-a08d-aaa7e7a3735e service nova] Creating event network-changed:f2393791-4dcd-48e5-ab8f-65b3058fd17e for instance 273ac187-4613-4832-a9a4-4cf53828d55f on hv-cinder-83538 Sep 22 17:10:26.898939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-0298f162-9048-48aa-8d5e-9864f9df97f2 req-bd75695b-15ef-405c-a08d-aaa7e7a3735e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040304 Sep 22 17:10:26.899550 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 197/398] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:10:27.044219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:27.053641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aa60443a-47dc-4bb9-9ce0-13f397b17f42 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1497 microversion: 2.1 time: 0.224561 Sep 22 17:10:27.054243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 202/399] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:26 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1497 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:27.419672 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:27.420373 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:27.427132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:27.427756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:27.428275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:27.429033 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:27.429559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:27.430065 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:27.571039 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:27.579497 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5076ac93-94eb-4864-ae35-8c09318dac29 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.164029 Sep 22 17:10:27.580123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 198/400] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:27 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:27.589065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:27.589671 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:27.596030 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:27.596511 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:27.596944 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:27.597626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:27.598069 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:27.598483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:27.667168 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:27.667581 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:27.673609 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:27.674078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:27.674504 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:27.675459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:27.675901 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:27.676316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:27.702401 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:10:27.730405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:27.738171 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-23aa245b-2c8e-4882-b911-5acfdaa548ec tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.153181 Sep 22 17:10:27.738882 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 203/401] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:27 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:27.780086 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-db163f4b-01e4-4764-8fcb-ee585b390353 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 204 len: 0 microversion: 2.1 time: 0.116668 Sep 22 17:10:27.781059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 199/402] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:10:27 2022] DELETE /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 17:10:27.790726 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:27.791982 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:27.799435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:27.800185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:27.800617 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:27.801512 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:27.801965 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:27.802388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:27.992121 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:28.000729 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-21eb0984-856e-4e54-9ee0-83e4be678343 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1503 microversion: 2.1 time: 0.215269 Sep 22 17:10:28.001307 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 204/403] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:27 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:28.603998 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:28.604722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:28.610627 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:28.611145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:28.611606 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:28.612301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:28.612753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:28.613175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:28.756633 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:28.762527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:28.763176 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:28.765654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-000f9523-d969-4faa-a853-b0a3a2d916ca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.165874 Sep 22 17:10:28.766195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 200/404] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:28 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:28.769087 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:28.769571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:28.770007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:28.770700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:28.771194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:28.771618 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:28.904728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:28.912648 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5b9b9750-a2ec-4516-87e2-e2dabb11d258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.154604 Sep 22 17:10:28.913221 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 205/405] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:28 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:29.024133 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:29.024737 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:29.030787 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:29.031303 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:29.031745 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:29.032440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:29.032887 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:29.033311 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:29.163813 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:29.171279 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-860d368a-9327-4e91-9f87-3294e4519519 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1503 microversion: 2.1 time: 0.151130 Sep 22 17:10:29.171916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 201/406] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:29 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:29.789698 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:29.790333 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:29.797097 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:29.797659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:29.798096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:29.798786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:29.799267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:29.799941 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:29.935686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:29.936295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:29.942293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:29.942775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:29.943247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:29.943940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:29.944390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:29.944815 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:30.150974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:30.159046 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d208d4e1-d052-48ba-90e5-e401de9d944c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.373482 Sep 22 17:10:30.159633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 206/407] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:29 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:30.197137 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:30.197756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:30.204545 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:30.205328 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:30.205989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:30.206760 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:30.207261 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:30.207679 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:30.309603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:30.319439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8a427835-9115-42ee-a00c-88bf77c35b67 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.387444 Sep 22 17:10:30.320278 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 202/408] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:29 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:30.334407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:30.335536 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:30.344183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:30.344680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:30.346465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:30.347312 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:30.347959 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:30.348397 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:30.376473 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:10:30.402651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:30.411272 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f8b7c4fa-af44-4fd3-b9ed-ea5f66ba2451 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1503 microversion: 2.1 time: 0.219121 Sep 22 17:10:30.412156 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 207/409] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:30 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:30.468860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a07686b2-58b8-4c06-a379-de0f58c0681c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 204 len: 0 microversion: 2.1 time: 0.139675 Sep 22 17:10:30.469462 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 203/410] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:10:30 2022] DELETE /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:10:30.477754 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:30.478367 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:30.492442 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:30.492943 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:30.493374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:30.495152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:30.495717 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:30.496508 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:30.565521 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-d38c7828-0e94-41e5-9b1e-7654b7b199b4 req-e72fc66e-6201-4ac6-ba51-bd2b40277fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c1c162-44d4-4441-8009-032e602e9418", "name": "network-vif-deleted", "tag": "7c1dd24d-7949-4eb9-8891-ea0b4a095c46"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:30.575692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d38c7828-0e94-41e5-9b1e-7654b7b199b4 req-e72fc66e-6201-4ac6-ba51-bd2b40277fab service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:30.576080 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d38c7828-0e94-41e5-9b1e-7654b7b199b4 req-e72fc66e-6201-4ac6-ba51-bd2b40277fab service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:30.576501 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d38c7828-0e94-41e5-9b1e-7654b7b199b4 req-e72fc66e-6201-4ac6-ba51-bd2b40277fab service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:30.588754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-d38c7828-0e94-41e5-9b1e-7654b7b199b4 req-e72fc66e-6201-4ac6-ba51-bd2b40277fab service nova] Creating event network-vif-deleted:7c1dd24d-7949-4eb9-8891-ea0b4a095c46 for instance a7c1c162-44d4-4441-8009-032e602e9418 on hv-cinder-83538 Sep 22 17:10:30.593594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-d38c7828-0e94-41e5-9b1e-7654b7b199b4 req-e72fc66e-6201-4ac6-ba51-bd2b40277fab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032177 Sep 22 17:10:30.594188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 204/411] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:10:30.639654 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:30.647942 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d052a441-3f7b-423a-bfe2-54526e823a1d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1512 microversion: 2.1 time: 0.174117 Sep 22 17:10:30.648526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 208/412] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:30 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:31.183475 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:31.184165 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:31.191126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:31.191615 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:31.192050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:31.192839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:31.193412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:31.193941 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:31.343985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:31.344595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:31.351237 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:31.351720 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:31.352160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:31.352853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:31.353303 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:31.354312 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:31.412586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:31.421186 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8deaeae2-d4d7-4f5b-b531-8a50cf68433d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.241935 Sep 22 17:10:31.421748 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 205/413] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:31 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:31.437200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:31.437200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:31.443209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:31.443697 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:31.444131 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:31.444824 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:31.445276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:31.445704 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:31.522253 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:31.530725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e47b74cd-384c-4879-beaf-aeb127174020 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1298 microversion: 2.1 time: 0.098955 Sep 22 17:10:31.531352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 206/414] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:31 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:31.544982 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:31.553024 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c3333377-06df-47b5-b3b2-02c21de53d1b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.212956 Sep 22 17:10:31.553604 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 209/415] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:31 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:31.672442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:31.673042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:31.679233 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:31.679704 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:31.680162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:31.680840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:31.681284 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:31.681698 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:31.830076 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:31.839035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-45da1ffe-67ed-4d5c-acf4-ab1ad94657fc tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1512 microversion: 2.1 time: 0.169843 Sep 22 17:10:31.839629 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 207/416] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:31 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:32.444958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:32.445610 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:32.452049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:32.452535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:32.452965 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:32.453651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:32.454101 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:32.454524 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:32.554034 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:32.554805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:32.561477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:32.561966 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:32.562395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:32.563200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:32.563657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:32.564093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:32.586869 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:32.594670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6f16e645-1fbb-408d-acab-b7ffddbd3c9f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.153671 Sep 22 17:10:32.595279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 210/417] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:32 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:32.599698 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:32.600298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:32.606726 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:32.607242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:32.607672 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:32.608372 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:32.608831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:32.609259 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:32.627736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:32.627974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:32.635839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-285459ef-8a3e-4fa1-ae65-4fddd8ae3589 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1298 microversion: 2.1 time: 0.085864 Sep 22 17:10:32.636424 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 208/418] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:32 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:32.744658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:32.752703 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dc95402b-1024-496f-a261-ba98a2930cf9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.156405 Sep 22 17:10:32.753286 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 211/419] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:32 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:32.862499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:32.863189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:32.869619 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:32.870112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:32.870546 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:32.871301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:32.871752 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:32.872218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:33.031985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:33.039850 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-80224cc4-8c74-4e79-bce1-14874002fa45 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1512 microversion: 2.1 time: 0.181679 Sep 22 17:10:33.040458 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 209/420] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:32 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:33.618709 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:33.619872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:33.626829 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:33.627346 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:33.627788 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:33.628540 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:33.628999 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:33.629422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:33.659558 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:33.660166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:33.666340 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:33.666838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:33.667352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:33.668051 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:33.668499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:33.668959 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:33.672041 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:33.705911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:33.706395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:33.706833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:33.707313 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lazy-loading 'fault' on Instance uuid a7c1c162-44d4-4441-8009-032e602e9418 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:10:33.770697 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:33.778768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3507f69b-d11a-445e-a935-17932e84e237 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1303 microversion: 2.1 time: 0.123320 Sep 22 17:10:33.779453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 210/421] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:33 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:33.784114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:33.784663 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:33.790536 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:33.791565 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:33.793686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:33.793686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:33.793686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:33.793686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:33.801479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:33.810896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1886ca66-2b45-46d8-9733-797a7734572f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.195964 Sep 22 17:10:33.811546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 212/422] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:33 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:33.928731 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:33.937013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-74a08070-4152-46c7-8afe-43be046ffb06 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.156596 Sep 22 17:10:33.937575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 211/423] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:33 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:34.064644 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:34.065246 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:34.071217 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:34.071692 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:34.072117 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:34.072789 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:34.073229 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:34.073647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:34.211498 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:34.220493 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2621f5f2-3103-47b7-95c7-625cf15a3cfb tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1512 microversion: 2.1 time: 0.159749 Sep 22 17:10:34.221080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 213/424] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:34 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:34.802683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:34.803383 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:34.809426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:34.809897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:34.810322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:34.811029 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:34.811475 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:34.811888 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:34.833771 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:34.834379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:34.841543 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:34.842021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:34.842442 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:34.843166 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:34.843339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:34.843611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:34.843816 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:34.844031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:34.844246 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:34.844685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lazy-loading 'fault' on Instance uuid a7c1c162-44d4-4441-8009-032e602e9418 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:10:34.888118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:34.895882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-af1dbbe3-5bf3-4655-b6f3-46ede4434aec tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1303 microversion: 2.1 time: 0.097253 Sep 22 17:10:34.896459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 212/425] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:34 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:34.959445 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:34.960055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:34.966402 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:34.966882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:34.967344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:34.968049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:34.968493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:34.969029 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:34.985498 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:34.993820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-134d43bb-409c-4454-955d-fca2e38ae8b3 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.163920 Sep 22 17:10:34.994901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 214/426] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:34 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:35.106670 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:35.115011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-34285472-1d64-4c6d-b964-9c8f84e0a2de tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.159381 Sep 22 17:10:35.115585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 213/427] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:34 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:35.244684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:35.245276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:35.251245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:35.251734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:35.252171 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:35.252867 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:35.253325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:35.253747 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:35.383046 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:35.390809 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-59e18b0e-2038-4bb5-b5b8-c8691ab3bb6b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1512 microversion: 2.1 time: 0.150624 Sep 22 17:10:35.391404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 215/428] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:35 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:35.918264 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:35.918856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:35.925057 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:35.925535 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:35.925959 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:35.926632 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:35.927103 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:35.927518 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:35.958114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:35.958500 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:35.958926 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:35.959434 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lazy-loading 'fault' on Instance uuid a7c1c162-44d4-4441-8009-032e602e9418 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:10:36.002659 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:36.011004 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a0f5a7d9-dd9d-4ae5-af3d-91bbce23444c tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1303 microversion: 2.1 time: 0.097172 Sep 22 17:10:36.011902 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 214/429] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:35 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:36.019359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:36.020003 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:36.027049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:36.027536 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:36.027971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:36.028664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:36.029122 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:36.029543 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:36.140290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:36.141244 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:36.151187 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:36.151627 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:36.152149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:36.155317 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:36.155317 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:36.155317 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:36.183668 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:36.192044 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fdde4a6d-a8d3-463e-b63a-f0b86acca1ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.176439 Sep 22 17:10:36.192635 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 216/430] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:36 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:36.332700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:36.340906 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-68d667ea-9053-4ed7-96dd-c7e525958f22 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.206806 Sep 22 17:10:36.341476 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 215/431] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:36 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:36.414649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:36.415296 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:36.422188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:36.423080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:36.423867 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:36.425202 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:36.425840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:36.426268 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:36.591074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:36.601703 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2f6470c3-d380-4454-8713-9e6b6a48a1e4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1512 microversion: 2.1 time: 0.192097 Sep 22 17:10:36.602275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 217/432] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:36 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:37.037667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:37.039324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:37.050286 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:37.052656 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:37.053277 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:37.054318 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:37.054864 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:37.055348 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:37.100453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:37.100933 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:37.101369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:37.101814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lazy-loading 'fault' on Instance uuid a7c1c162-44d4-4441-8009-032e602e9418 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:10:37.159921 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad9fb3dd77d47c190e14cf504ea4d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c516bf5715a42cd860981f82fc58b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:37.180228 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d830c705-0874-4191-aad6-cd6e1b5be017 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 200 len: 1303 microversion: 2.1 time: 0.149307 Sep 22 17:10:37.181692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 216/433] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:37 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:37.216773 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:37.217438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:37.225748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:37.226983 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:37.227427 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:37.228163 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:37.229148 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:37.229562 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:37.372564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:37.373464 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:37.380094 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:37.381044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:37.381977 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:37.383002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:37.383573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:37.384234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:37.612632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:37.628304 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c7ee86e7-1757-4b19-b6c3-3fc6c4217869 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.415880 Sep 22 17:10:37.646799 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 218/434] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:37 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:37.656163 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:37.656898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:37.665065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:37.665884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:37.666325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:37.667141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:37.667653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:37.668091 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:37.806075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:37.827113 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-932c3734-52bc-4916-9c7c-c1f15991f4a4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.459783 Sep 22 17:10:37.827942 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 217/435] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:37 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:38.021665 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:38.036693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-28676471-7d21-4eb2-be36-45fa8f0bf237 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1512 microversion: 2.1 time: 0.390522 Sep 22 17:10:38.045899 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 219/436] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:37 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1512 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:38.208160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:38.209130 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] [instance: a7c1c162-44d4-4441-8009-032e602e9418] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:38.218768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:38.219278 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:38.219713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:38.220404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:38.221045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:38.222440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:38.240189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] HTTP exception thrown: Instance a7c1c162-44d4-4441-8009-032e602e9418 could not be found. Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Request method failure captured: Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 HTTP/1.1 Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJaxV2qV5P3L2Sw_PG_L1FInlpoCUdG7xVI4Z1kPIkphXs7SBCeGUpW79QYT5JBHxH6GJCwZzraGUpQpQqrHfbwJI1BQ6-Q5yePpL4xW8UGr-Sy-bAHymCT6C3slUGLa8zCrMZ79OQWvU3VMEIPKXYXlNWKXAvxd3z9dUJufWpCnNmg Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 6c516bf5715a42cd860981f82fc58b15 Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-VolumesActionsTest-258959910 Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:10:38.243219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c516bf5715a42cd860981f82fc58b15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6c516bf5715a42cd860981f82fc58b15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6c516bf5715a42cd860981f82fc58b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6c516bf5715a42cd860981f82fc58b15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-VolumesActionsTest-258959910 Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 6c516bf5715a42cd860981f82fc58b15 Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-VolumesActionsTest-258959910 Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-VolumesActionsTest-258959910-project Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 2ad9fb3dd77d47c190e14cf504ea4d3d Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-VolumesActionsTest-258959910-project Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance a7c1c162-44d4-4441-8009-032e602e9418 could not be found. Sep 22 17:10:38.244805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': 'a7c1c162-44d4-4441-8009-032e602e9418'} Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c1c162-44d4-4441-8009-032e602e9418 could not be found. Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:10:38.245638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c1c162-44d4-4441-8009-032e602e9418 could not be found. Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c1c162-44d4-4441-8009-032e602e9418 could not be found. Sep 22 17:10:38.247066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:38.249188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] Returning 404 to user: Instance a7c1c162-44d4-4441-8009-032e602e9418 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:10:38.250203 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fb20cc66-5e06-4299-a883-288e484b5ef1 tempest-VolumesActionsTest-258959910 tempest-VolumesActionsTest-258959910-project] 10.222.0.16 "GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418" status: 404 len: 111 microversion: 2.1 time: 0.047231 Sep 22 17:10:38.250934 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 218/437] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:38 2022] GET /compute/v2.1/servers/a7c1c162-44d4-4441-8009-032e602e9418 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:10:38.361527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-bcb5da70-951e-4a0b-928f-e6f9d6570240 req-73fcf4f2-efcd-455f-affa-50f1e4fc7e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34975170-3fed-4365-af86-d8375013ad5c", "name": "network-vif-deleted", "tag": "90ee9eab-8000-4105-98b8-1323d939e7e8"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:38.375335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-bcb5da70-951e-4a0b-928f-e6f9d6570240 req-73fcf4f2-efcd-455f-affa-50f1e4fc7e01 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:38.375887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-bcb5da70-951e-4a0b-928f-e6f9d6570240 req-73fcf4f2-efcd-455f-affa-50f1e4fc7e01 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:38.376611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-bcb5da70-951e-4a0b-928f-e6f9d6570240 req-73fcf4f2-efcd-455f-affa-50f1e4fc7e01 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:38.397693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-bcb5da70-951e-4a0b-928f-e6f9d6570240 req-73fcf4f2-efcd-455f-affa-50f1e4fc7e01 service nova] Creating event network-vif-deleted:90ee9eab-8000-4105-98b8-1323d939e7e8 for instance 34975170-3fed-4365-af86-d8375013ad5c on hv-cinder-83538 Sep 22 17:10:38.405562 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-bcb5da70-951e-4a0b-928f-e6f9d6570240 req-73fcf4f2-efcd-455f-affa-50f1e4fc7e01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048015 Sep 22 17:10:38.419261 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 220/438] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:10:38.659263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:38.659985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:38.667021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:38.668735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:38.668735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:38.669059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:38.669490 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:38.670068 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:38.856447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:38.857145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:38.874892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:38.875617 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:38.877882 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:38.878939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:38.879528 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:38.882483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:39.003796 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:39.021291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a16169b3-b4b8-4550-9ea8-4e9af29276f2 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.364928 Sep 22 17:10:39.021940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 219/439] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:38 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:39.074642 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:39.075771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:39.077714 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:39.085312 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:39.085924 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:39.086468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:39.087320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:39.088426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:39.088952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:39.127262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:39.127855 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:39.128488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:39.129120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lazy-loading 'fault' on Instance uuid 34975170-3fed-4365-af86-d8375013ad5c {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:10:39.210718 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:39.217481 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:39.221315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bab43f51-05a2-48e7-864a-fa5b79e4a359 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 200 len: 1308 microversion: 2.1 time: 0.150610 Sep 22 17:10:39.235805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 220/440] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:39 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:39.235907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c6d69f0a-3446-456a-a626-1a76bde122e7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.380673 Sep 22 17:10:39.235999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-d7594b78-72f8-407a-84da-d24ae9c84652 req-b53c03e0-1e8f-4632-a565-b7c0623b05a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273ac187-4613-4832-a9a4-4cf53828d55f", "name": "network-vif-plugged", "status": "completed", "tag": "f2393791-4dcd-48e5-ab8f-65b3058fd17e"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:39.236101 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 221/441] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:38 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:39.254307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d7594b78-72f8-407a-84da-d24ae9c84652 req-b53c03e0-1e8f-4632-a565-b7c0623b05a5 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:39.255378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d7594b78-72f8-407a-84da-d24ae9c84652 req-b53c03e0-1e8f-4632-a565-b7c0623b05a5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:39.256170 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d7594b78-72f8-407a-84da-d24ae9c84652 req-b53c03e0-1e8f-4632-a565-b7c0623b05a5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:39.276345 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-d7594b78-72f8-407a-84da-d24ae9c84652 req-b53c03e0-1e8f-4632-a565-b7c0623b05a5 service nova] Creating event network-vif-plugged:f2393791-4dcd-48e5-ab8f-65b3058fd17e for instance 273ac187-4613-4832-a9a4-4cf53828d55f on hv-cinder-83538 Sep 22 17:10:39.283865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-d7594b78-72f8-407a-84da-d24ae9c84652 req-b53c03e0-1e8f-4632-a565-b7c0623b05a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059019 Sep 22 17:10:39.284285 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 221/442] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:10:40.050346 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:40.051474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:40.059645 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:40.060132 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:40.060559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:40.061466 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:40.062098 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:40.062523 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:40.204737 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:40.212905 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b4920a17-10e4-411f-a272-43dc8bf7b8c6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.167969 Sep 22 17:10:40.213491 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 222/443] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:40 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:40.247799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:40.248538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: 34975170-3fed-4365-af86-d8375013ad5c] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:40.254855 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:40.255583 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:40.255804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:40.256491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:40.256935 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:40.257348 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:40.272279 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] HTTP exception thrown: Instance 34975170-3fed-4365-af86-d8375013ad5c could not be found. Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Request method failure captured: Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c HTTP/1.1 Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJaVpgiztDwmXzkgEyH961px0NYGUoVfsl-GoGS-riAU8vAtcvfYFtLOy781YWynmxoi6w_7eoJfzo0R-JKwc6FunjCascJQzPCGqij-uxBevorHirzzyqgk82uNBYq1HqTHS_tV_r2zgRmpiXqyHWMpPgO7SZ6q_VvOLIjm6bwEm2E Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 78cce6768e1a473f9056d179b605df6d Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1263262637 Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:10:40.273946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78cce6768e1a473f9056d179b605df6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78cce6768e1a473f9056d179b605df6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/78cce6768e1a473f9056d179b605df6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_78cce6768e1a473f9056d179b605df6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-VolumesSnapshotTestJSON-1263262637 Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 78cce6768e1a473f9056d179b605df6d Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1263262637 Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-VolumesSnapshotTestJSON-1263262637-project Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 4386cce77ec047f480e9999aeb103da5 Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-VolumesSnapshotTestJSON-1263262637-project Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 34975170-3fed-4365-af86-d8375013ad5c could not be found. Sep 22 17:10:40.276689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '34975170-3fed-4365-af86-d8375013ad5c'} Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34975170-3fed-4365-af86-d8375013ad5c could not be found. Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:10:40.278344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34975170-3fed-4365-af86-d8375013ad5c could not be found. Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34975170-3fed-4365-af86-d8375013ad5c could not be found. Sep 22 17:10:40.282235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:10:40.284208 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:40.284362 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Returning 404 to user: Instance 34975170-3fed-4365-af86-d8375013ad5c could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:10:40.284485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:40.284634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ec83e8ee-1b2a-405d-8231-a1ae80b1e62b tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c" status: 404 len: 111 microversion: 2.1 time: 0.032328 Sep 22 17:10:40.284634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 222/444] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:40 2022] GET /compute/v2.1/servers/34975170-3fed-4365-af86-d8375013ad5c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:10:40.284877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:40.284877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:40.284877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:40.286066 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:40.286877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:40.287712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:40.464625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:40.477548 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a43f0d22-80bf-4094-a1f9-19465dc0c29b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.207249 Sep 22 17:10:40.488500 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 223/445] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:40 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:41.236477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:41.237087 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:41.243767 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:41.244518 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:41.245286 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:41.246691 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:41.246824 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:41.247596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:41.398502 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:41.407127 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fc0b54b8-228e-407d-9dcb-606816aa23f1 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.174790 Sep 22 17:10:41.407707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 223/446] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:41 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:41.515769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:41.516319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:41.523102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:41.523594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:41.524023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:41.524748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:41.525761 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:41.526173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:41.670825 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:41.679303 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-46093747-aa7b-4aa9-81b9-7d08be3abe0f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.167341 Sep 22 17:10:41.679877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 224/447] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:41 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:42.429932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:42.430651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:42.437371 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:42.437867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:42.438306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:42.439031 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:42.439490 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:42.439916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:42.577478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:42.585782 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4f54f1b6-6291-4cca-a00a-eff9b285e865 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.159645 Sep 22 17:10:42.586754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 224/448] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:42 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:42.714397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:42.715037 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:42.721984 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:42.722471 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:42.722917 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:42.723637 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:42.724090 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:42.724512 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:42.866772 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:42.874757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8c04f61c-27e2-4346-851f-987c0c85f628 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.164816 Sep 22 17:10:42.875365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 225/449] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:42 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:43.319701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-39877cd4-d5b4-499f-948f-15174ce5bc17 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:43.320298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-39877cd4-d5b4-499f-948f-15174ce5bc17 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:43.326981 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-39877cd4-d5b4-499f-948f-15174ce5bc17 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:43.327477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-39877cd4-d5b4-499f-948f-15174ce5bc17 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:43.327912 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-39877cd4-d5b4-499f-948f-15174ce5bc17 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:43.328604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-39877cd4-d5b4-499f-948f-15174ce5bc17 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:43.329056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-39877cd4-d5b4-499f-948f-15174ce5bc17 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:43.329478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-39877cd4-d5b4-499f-948f-15174ce5bc17 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:43.353683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-39877cd4-d5b4-499f-948f-15174ce5bc17 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/ips" status: 200 len: 145 microversion: 2.1 time: 0.037790 Sep 22 17:10:43.354799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 225/450] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:10:43 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:10:43.610456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:43.611104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:43.617705 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:43.618203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:43.618669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:43.619408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:43.620490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:43.620919 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:43.768918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:43.777031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-afac8bb1-16a1-4741-8cc9-7987cc9fbafe tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.170668 Sep 22 17:10:43.777601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 226/451] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:43 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:43.898218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:43.898853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:43.906232 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:43.906712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:43.907175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:43.907876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:43.908320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:43.908736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:44.050555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:44.058622 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ee053db8-2299-4187-b0c1-1f73473e5f0c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.164484 Sep 22 17:10:44.059227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 226/452] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:43 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:44.800116 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:44.800758 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:44.807653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:44.808159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:44.808586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:44.809312 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:44.809763 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:44.810183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:44.958324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:44.967559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1ce74082-1451-45ef-aab5-8eb5d8a63a3a tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.171454 Sep 22 17:10:44.968152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 227/453] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:44 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:45.084878 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:45.086009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:45.097088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:45.098004 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:45.099145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:45.100409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:45.101269 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:45.102056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:45.135804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:45.284245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:45.293157 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-97a176d3-928f-491a-8920-5b709f3bf9f5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.215126 Sep 22 17:10:45.293741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 227/454] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:45 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:45.997314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:45.998134 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:46.004892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:46.005381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:46.005815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:46.006522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:46.007010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:46.007433 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:46.148191 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:46.151758 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:46.157049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3b06361f-c251-4a91-8f62-608aa59a1e9d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.165162 Sep 22 17:10:46.157631 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 228/455] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:45 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:46.331335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:46.331954 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:46.338102 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:46.339162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:46.339601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:46.340302 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:46.340757 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:46.341185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:46.478600 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:46.487409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1f56222b-56d6-4f85-a6e7-75566e477b9a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.159580 Sep 22 17:10:46.488238 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 228/456] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:46 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:47.180443 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:47.180998 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:47.188361 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:47.188847 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:47.189277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:47.189983 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:47.190432 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:47.190853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:47.343637 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:47.351758 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8c6115ac-c81c-4936-b895-49155762580c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.175406 Sep 22 17:10:47.352345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 229/457] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:47 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:47.513114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:47.513679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:47.519900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:47.520396 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:47.520834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:47.521542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:47.521997 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:47.522438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:47.688842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:47.697173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0d2cd47c-eaf7-4ded-850d-eb7a4605e326 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.189327 Sep 22 17:10:47.697795 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 229/458] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:47 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:48.376561 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:48.377112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:48.383571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:48.384056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:48.384480 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:48.385758 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:48.386207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:48.386626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:48.549420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:48.557501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-53e22cf4-7cfe-4558-9692-6123d0687401 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.184823 Sep 22 17:10:48.558077 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 230/459] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:48 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:48.721915 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:48.722570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:48.728697 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:48.729180 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:48.729609 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:48.730302 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:48.730739 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:48.731192 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:48.882277 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:48.890986 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-07b28267-6a23-4e2b-8346-3a058a04785b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.172986 Sep 22 17:10:48.891926 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 230/460] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:48 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:49.580803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:49.581731 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:49.590106 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:49.590604 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:49.591238 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:49.592082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:49.592541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:49.592993 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:49.756511 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:49.767205 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2d6601e6-b3a0-4756-9ae9-137c65f1e3ff tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.190220 Sep 22 17:10:49.767806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 231/461] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:49 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:49.919843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:49.921049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:49.929818 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:49.930543 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:49.931129 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:49.932458 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:49.933702 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:49.934694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:50.097912 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:50.106616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6f48865c-ed09-4668-a96e-060db7bb7316 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.192880 Sep 22 17:10:50.107253 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 231/462] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:49 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:50.792428 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:50.793042 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:50.800196 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:50.800848 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:50.801445 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:50.802281 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:50.802845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:50.803307 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:50.969622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:50.977838 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b3d04751-e14d-4e36-af78-15b81a908724 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.189980 Sep 22 17:10:50.979395 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 232/463] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:50 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:51.133444 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:51.134332 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:51.143417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:51.144448 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:51.145058 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:51.146261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:51.147042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:51.147776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:51.379422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:51.391959 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-eaf9aec4-3c1c-4e5a-87f4-ee877a7927c1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1370 microversion: 2.1 time: 0.262009 Sep 22 17:10:51.393250 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 232/464] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:51 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:51.819389 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-5c3d7310-7584-4a7d-b421-46c19e7e6643 req-10fc5c79-0e2b-4e60-81ef-2700521bf8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e671ca-5873-4190-9048-a875393d1055", "name": "network-vif-plugged", "status": "completed", "tag": "bfa945c1-4510-4653-9180-db1133adbc18"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:51.831201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=78 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:10:51.842420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-5c3d7310-7584-4a7d-b421-46c19e7e6643 req-10fc5c79-0e2b-4e60-81ef-2700521bf8a8 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:51.843323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-5c3d7310-7584-4a7d-b421-46c19e7e6643 req-10fc5c79-0e2b-4e60-81ef-2700521bf8a8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:51.843944 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-5c3d7310-7584-4a7d-b421-46c19e7e6643 req-10fc5c79-0e2b-4e60-81ef-2700521bf8a8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:51.859803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-5c3d7310-7584-4a7d-b421-46c19e7e6643 req-10fc5c79-0e2b-4e60-81ef-2700521bf8a8 service nova] Creating event network-vif-plugged:bfa945c1-4510-4653-9180-db1133adbc18 for instance 60e671ca-5873-4190-9048-a875393d1055 on hv-cinder-83538 Sep 22 17:10:51.867133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-5c3d7310-7584-4a7d-b421-46c19e7e6643 req-10fc5c79-0e2b-4e60-81ef-2700521bf8a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052416 Sep 22 17:10:51.869958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 233/465] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:10:52.018521 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:52.019308 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:52.026025 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:52.026818 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:52.027554 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:52.029057 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:52.030407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:52.030979 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:52.151653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3eac93c7-2946-4c71-be8b-d0f341623bc8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9acd6c25-706b-4eaf-9b77-fa9cd1dfeba5"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:52.154565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3eac93c7-2946-4c71-be8b-d0f341623bc8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:52.164588 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3eac93c7-2946-4c71-be8b-d0f341623bc8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:52.165534 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3eac93c7-2946-4c71-be8b-d0f341623bc8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:52.167001 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3eac93c7-2946-4c71-be8b-d0f341623bc8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:52.167996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3eac93c7-2946-4c71-be8b-d0f341623bc8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:52.168661 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3eac93c7-2946-4c71-be8b-d0f341623bc8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:52.169316 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3eac93c7-2946-4c71-be8b-d0f341623bc8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:52.770868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:52.792511 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4676775d-0939-42cf-84e3-91a1e4090d78 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.778162 Sep 22 17:10:52.793396 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 233/466] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:52 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:10:52.797614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3eac93c7-2946-4c71-be8b-d0f341623bc8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.651311 Sep 22 17:10:52.800228 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 234/467] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:10:52 2022] POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/os-volume_attachments => generated 194 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:10:52.803465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:52.807140 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:52.828099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:52.829018 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:52.829749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:52.834335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:52.840209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:52.840864 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:53.053836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:53.066708 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7c5bcf42-47ee-41d1-b141-3504b9732082 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1563 microversion: 2.1 time: 0.268721 Sep 22 17:10:53.067976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 234/468] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:52 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:53.104916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6f5b9724-53c0-4482-a0e5-b2f0ba3e8c9b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:53.106240 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6f5b9724-53c0-4482-a0e5-b2f0ba3e8c9b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:53.114576 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f5b9724-53c0-4482-a0e5-b2f0ba3e8c9b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:53.115145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f5b9724-53c0-4482-a0e5-b2f0ba3e8c9b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:53.115703 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f5b9724-53c0-4482-a0e5-b2f0ba3e8c9b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:53.116324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f5b9724-53c0-4482-a0e5-b2f0ba3e8c9b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:53.116787 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f5b9724-53c0-4482-a0e5-b2f0ba3e8c9b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:53.117214 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f5b9724-53c0-4482-a0e5-b2f0ba3e8c9b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:53.240745 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6f5b9724-53c0-4482-a0e5-b2f0ba3e8c9b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140831 Sep 22 17:10:53.241921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 235/469] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 22 17:10:53 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:10:53.820262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:53.820876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:53.828022 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:53.828814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:53.829406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:53.830290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:53.830896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:53.831493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:54.155466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:54.173700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d84aa105-a578-45e5-a140-2cc0be0eeb21 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.356816 Sep 22 17:10:54.175931 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 235/470] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:53 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:54.668137 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-b174d4c4-637d-4302-9f24-8049508cc918 req-35fd84aa-f13c-42b1-b1ad-5d53335d4b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273ac187-4613-4832-a9a4-4cf53828d55f", "tag": "f2393791-4dcd-48e5-ab8f-65b3058fd17e"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:54.676641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b174d4c4-637d-4302-9f24-8049508cc918 req-35fd84aa-f13c-42b1-b1ad-5d53335d4b7a service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:54.677094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b174d4c4-637d-4302-9f24-8049508cc918 req-35fd84aa-f13c-42b1-b1ad-5d53335d4b7a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:54.678905 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b174d4c4-637d-4302-9f24-8049508cc918 req-35fd84aa-f13c-42b1-b1ad-5d53335d4b7a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:54.698297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-b174d4c4-637d-4302-9f24-8049508cc918 req-35fd84aa-f13c-42b1-b1ad-5d53335d4b7a service nova] Creating event network-changed:f2393791-4dcd-48e5-ab8f-65b3058fd17e for instance 273ac187-4613-4832-a9a4-4cf53828d55f on hv-cinder-83538 Sep 22 17:10:54.707323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-b174d4c4-637d-4302-9f24-8049508cc918 req-35fd84aa-f13c-42b1-b1ad-5d53335d4b7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045756 Sep 22 17:10:54.708270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 236/471] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:10:55.200691 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:55.201736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:55.210120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:55.210912 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:55.212043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:55.213664 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:55.214380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:55.215017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:55.393625 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:55.405022 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b4db5e77-b9a8-434d-bd2b-59eb73c4dcc5 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.210902 Sep 22 17:10:55.406071 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 236/472] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:55 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:56.431030 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:56.433664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:56.444920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:56.446296 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:56.447362 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:56.448651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:56.450054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:56.450832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:56.689314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:56.706068 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d0028662-2b8f-4a1a-9fda-7ec76f248e75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.279586 Sep 22 17:10:56.725560 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 237/473] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:56 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:57.730928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:57.731759 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:57.738659 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:57.739216 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:57.739654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:57.740475 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:57.740839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:57.741266 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:57.957384 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:57.967178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-afdaea18-3895-453c-85d2-35e5ed380cc6 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.240948 Sep 22 17:10:57.967772 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 237/474] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:57 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:59.020572 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:10:59.022628 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:10:59.050833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:59.051511 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:59.052156 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:59.053071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:59.053804 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:59.054442 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:59.193796 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-314758973", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "networks": [{"uuid": "e3d57eb8-841d-4942-9243-4eda619be6ae"}]}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:10:59.260389 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:10:59.263001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] validate_networks() for [('e3d57eb8-841d-4942-9243-4eda619be6ae', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:10:59.288520 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6fa92120-ed91-4f46-8f56-c726ea37f739 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.274601 Sep 22 17:10:59.289611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 238/475] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:10:59 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:10:59.943678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:10:59.944163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:10:59.945166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:10:59.945818 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:10:59.946410 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:10:59.958487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:59.959033 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:59.959427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:59.960162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:10:59.960805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:10:59.961397 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:10:59.982195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Getting quotas for project 78cce6768e1a473f9056d179b605df6d. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:10:59.986972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Getting quotas for user 4386cce77ec047f480e9999aeb103da5 and project 78cce6768e1a473f9056d179b605df6d. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:11:00.001604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:11:00.007303 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:11:00.063610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8c63ce3a-fb04-4d06-a9a3-e4b22d8af6a4 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.873363 Sep 22 17:11:00.076305 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 238/476] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:10:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:11:00.083232 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-90676482-ecfc-418f-8ddd-ec80a3b174bf tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:00.083926 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-90676482-ecfc-418f-8ddd-ec80a3b174bf tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:00.206151 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-90676482-ecfc-418f-8ddd-ec80a3b174bf tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:00.219699 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-90676482-ecfc-418f-8ddd-ec80a3b174bf tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1218 microversion: 2.1 time: 0.140398 Sep 22 17:11:00.221083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 239/477] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:00 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:00.315577 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:00.316555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:00.328418 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:00.329544 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:00.330698 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:00.332337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:00.333374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:00.334441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:00.611516 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:00.630055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2ffd05d9-4bac-4351-93b3-38feab8dc283 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1259 microversion: 2.1 time: 0.319003 Sep 22 17:11:00.632286 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 239/478] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:00 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1259 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:01.258250 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:01.259364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:01.283473 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:01.286103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:01.287759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:01.291774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:01.293245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:01.295040 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:01.436702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:01.446432 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2843eae9-6251-4720-8148-5de75e7775b5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1270 microversion: 2.1 time: 0.193331 Sep 22 17:11:01.449793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 240/479] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:01 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:01.661560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:01.662378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:01.670372 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:01.671150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:01.671667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:01.672473 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:01.673100 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:01.673574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:01.863542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:01.873445 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6d9ff667-a168-43ae-a016-dd2bfad7a3f7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1443 microversion: 2.1 time: 0.215851 Sep 22 17:11:01.873963 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 240/480] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:01 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1443 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:01.898564 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:01.899757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:01.908195 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:01.908959 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:01.909684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:01.910594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:01.911252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:01.911854 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:02.105227 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:02.121164 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ddd4efef-684e-415e-abbd-5a064d589cca tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1443 microversion: 2.1 time: 0.226421 Sep 22 17:11:02.121945 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 241/481] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:01 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1443 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:02.478908 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:02.479995 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:02.517570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:02.518445 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:02.519137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:02.520264 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:02.521016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:02.521732 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:02.838626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:02.846599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-339864a1-827b-4646-b10a-c2e017248a17 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1276 microversion: 2.1 time: 0.376370 Sep 22 17:11:02.847219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:02 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1276 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:03.877221 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:03.879498 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:03.895514 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:03.896998 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:03.898967 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:03.900803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:03.902394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:03.903144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:04.256239 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:04.265762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a401bbf9-a790-4071-9d0a-bd21bdb1d18e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.396075 Sep 22 17:11:04.291535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 242/483] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:03 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:05.132247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-eb9aed76-05ce-4773-9b33-91efd70a8e70 req-d9975f7f-ca6a-4430-8c89-a83cf0c40e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58f33b8-4007-4029-8727-568bbd91beb5", "tag": "c1027e91-59c4-4455-a230-d405860c4e3a"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:05.179034 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-eb9aed76-05ce-4773-9b33-91efd70a8e70 req-d9975f7f-ca6a-4430-8c89-a83cf0c40e75 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:05.195678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-eb9aed76-05ce-4773-9b33-91efd70a8e70 req-d9975f7f-ca6a-4430-8c89-a83cf0c40e75 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:05.204554 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-eb9aed76-05ce-4773-9b33-91efd70a8e70 req-d9975f7f-ca6a-4430-8c89-a83cf0c40e75 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:05.229319 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-eb9aed76-05ce-4773-9b33-91efd70a8e70 req-d9975f7f-ca6a-4430-8c89-a83cf0c40e75 service nova] Creating event network-changed:c1027e91-59c4-4455-a230-d405860c4e3a for instance f58f33b8-4007-4029-8727-568bbd91beb5 on hv-cinder-83538 Sep 22 17:11:05.256189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-eb9aed76-05ce-4773-9b33-91efd70a8e70 req-d9975f7f-ca6a-4430-8c89-a83cf0c40e75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132840 Sep 22 17:11:05.260481 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 242/484] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:11:05.305192 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:05.306892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:05.340788 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:05.341711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:05.342529 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:05.343909 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:05.344773 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:05.346653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:05.698303 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-786b87db-5de0-4b1a-a8fa-4bad656b26e5 req-f3bdc4c3-2559-4796-b5e2-1045d4be0dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e671ca-5873-4190-9048-a875393d1055", "tag": "bfa945c1-4510-4653-9180-db1133adbc18"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:05.710827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-786b87db-5de0-4b1a-a8fa-4bad656b26e5 req-f3bdc4c3-2559-4796-b5e2-1045d4be0dab service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:05.711611 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-786b87db-5de0-4b1a-a8fa-4bad656b26e5 req-f3bdc4c3-2559-4796-b5e2-1045d4be0dab service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:05.712262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-786b87db-5de0-4b1a-a8fa-4bad656b26e5 req-f3bdc4c3-2559-4796-b5e2-1045d4be0dab service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:05.728052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-786b87db-5de0-4b1a-a8fa-4bad656b26e5 req-f3bdc4c3-2559-4796-b5e2-1045d4be0dab service nova] Creating event network-changed:bfa945c1-4510-4653-9180-db1133adbc18 for instance 60e671ca-5873-4190-9048-a875393d1055 on hv-cinder-83538 Sep 22 17:11:05.735315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-786b87db-5de0-4b1a-a8fa-4bad656b26e5 req-f3bdc4c3-2559-4796-b5e2-1045d4be0dab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041525 Sep 22 17:11:05.745706 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 243/485] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:11:05.838858 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:05.849460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dae7abaf-48b4-4b6b-a277-96783bddca98 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.552922 Sep 22 17:11:05.850059 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 243/486] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:05 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:06.893049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:06.895695 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:06.919579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:06.920921 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:06.922021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:06.923666 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:06.924759 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:06.931210 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:07.225651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:07.237324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-64c3c0a3-0a10-4dfd-8f4e-e4b8806a117d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.362777 Sep 22 17:11:07.238178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 244/487] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:06 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:08.268339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:08.270579 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:08.284320 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:08.285643 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:08.286696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:08.288569 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:08.289667 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:08.293481 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:08.573372 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:08.585750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-197ef7a0-7b80-4a8e-9555-13077461648c tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.326433 Sep 22 17:11:08.586888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 244/488] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:08 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:09.630571 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:09.631682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:09.637667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:09.646886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:09.647562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:09.648146 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:09.649185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:09.649793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:09.650522 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:09.897524 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:09.907271 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d93811b0-57df-48b0-b5c2-d336ed71c79e tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.282517 Sep 22 17:11:09.908153 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 245/489] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:09 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:10.668202 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-04212a8d-1d1f-443e-9d79-29a4cbd332d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:10.668821 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-04212a8d-1d1f-443e-9d79-29a4cbd332d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:10.671169 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:10.677317 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04212a8d-1d1f-443e-9d79-29a4cbd332d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:10.677836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04212a8d-1d1f-443e-9d79-29a4cbd332d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:10.678266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04212a8d-1d1f-443e-9d79-29a4cbd332d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:10.678986 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04212a8d-1d1f-443e-9d79-29a4cbd332d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:10.679439 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04212a8d-1d1f-443e-9d79-29a4cbd332d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:10.679853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-04212a8d-1d1f-443e-9d79-29a4cbd332d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:10.705826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-04212a8d-1d1f-443e-9d79-29a4cbd332d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/ips" status: 200 len: 150 microversion: 2.20 time: 0.043210 Sep 22 17:11:10.706404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 245/490] 10.222.0.16 () {60 vars in 1289 bytes} [Thu Sep 22 17:11:10 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:11:10.939417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:10.941294 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:10.944629 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:10.945620 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:10.953982 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:10.954487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:10.954884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:10.955616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:10.956059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:10.956481 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:10.959415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:11.173804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:11.184554 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-aef13d53-9c25-47f6-8ac7-d98943c8fcd0 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.255738 Sep 22 17:11:11.200258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 246/491] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:10 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:11.704842 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e93474bf-2d48-4ae4-a60e-f9f1f684a837 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:11.715572 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93474bf-2d48-4ae4-a60e-f9f1f684a837 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:11.716877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93474bf-2d48-4ae4-a60e-f9f1f684a837 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:11.717896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93474bf-2d48-4ae4-a60e-f9f1f684a837 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:11.808401 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e93474bf-2d48-4ae4-a60e-f9f1f684a837 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Going to try to stop instance {{(pid=120805) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 22 17:11:11.830037 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:11.872639 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e93474bf-2d48-4ae4-a60e-f9f1f684a837 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/action" status: 202 len: 0 microversion: 2.1 time: 0.171629 Sep 22 17:11:11.873799 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 246/492] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:11:11 2022] POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:11:11.882577 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:11.883556 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:11.892125 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:11.892648 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:11.893309 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:11.894265 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:11.895014 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:11.896585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:12.090402 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:12.111431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-76a34b77-5021-466e-876f-ec5db16c3e54 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.232098 Sep 22 17:11:12.115069 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 247/493] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:11 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:12.211216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:12.211746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:12.218235 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:12.218623 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:12.219240 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:12.219823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:12.220277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:12.220691 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:12.401439 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:12.414861 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ba51bb39-48db-47ca-b492-64ad54d1720f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.208696 Sep 22 17:11:12.416703 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 247/494] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:12 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:13.136691 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:13.137224 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:13.143432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:13.143984 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:13.144416 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:13.145108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:13.145592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:13.146013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:13.285888 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:13.295428 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4693c849-7f37-4dbb-b9d5-3e33cce271d3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.162583 Sep 22 17:11:13.296061 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 248/495] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:13 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:13.439746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:13.440365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:13.447356 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:13.447856 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:13.448291 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:13.448973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:13.449418 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:13.449837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:13.597047 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:13.605635 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9af990a9-001d-496b-9e28-e8f376094970 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.169639 Sep 22 17:11:13.606651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 248/496] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:13 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:13.793706 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:13.794395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:13.800796 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:13.801422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:13.801846 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:13.802608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:13.803095 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:13.803523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:13.834856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lazy-loading 'flavor' on Instance uuid eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:11:14.116972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7a12b6a3-9214-485b-82a1-5803b414cb87 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/action" status: 202 len: 0 microversion: 2.20 time: 0.327353 Sep 22 17:11:14.119148 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 249/497] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 22 17:11:13 2022] POST /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:11:14.127201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:14.128102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:14.136012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:14.137734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:14.139000 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:14.140007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:14.140779 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:14.141366 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:14.252958 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-d12f82e0-5683-40f5-b3d9-c85de8bef04c req-3eeec34f-0f2c-42e9-a881-3214a201f7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58f33b8-4007-4029-8727-568bbd91beb5", "name": "network-vif-plugged", "status": "completed", "tag": "c1027e91-59c4-4455-a230-d405860c4e3a"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:14.265917 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d12f82e0-5683-40f5-b3d9-c85de8bef04c req-3eeec34f-0f2c-42e9-a881-3214a201f7b8 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:14.266892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d12f82e0-5683-40f5-b3d9-c85de8bef04c req-3eeec34f-0f2c-42e9-a881-3214a201f7b8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:14.267544 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d12f82e0-5683-40f5-b3d9-c85de8bef04c req-3eeec34f-0f2c-42e9-a881-3214a201f7b8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:14.280325 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-d12f82e0-5683-40f5-b3d9-c85de8bef04c req-3eeec34f-0f2c-42e9-a881-3214a201f7b8 service nova] Creating event network-vif-plugged:c1027e91-59c4-4455-a230-d405860c4e3a for instance f58f33b8-4007-4029-8727-568bbd91beb5 on hv-cinder-83538 Sep 22 17:11:14.285833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-d12f82e0-5683-40f5-b3d9-c85de8bef04c req-3eeec34f-0f2c-42e9-a881-3214a201f7b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037194 Sep 22 17:11:14.286637 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 250/498] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:11:14.322180 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:14.323069 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:14.330109 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:14.330614 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:14.331083 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:14.331804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:14.332262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:14.332839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:14.349836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:14.360103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:14.362808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:14.364405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-87ed2c38-de38-4528-a1e2-3ec3890a06d2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.241308 Sep 22 17:11:14.365193 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 249/499] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:14 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:14.491080 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:14.503130 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1914ac0e-f317-4176-8e4a-0158e7e6c86a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.186404 Sep 22 17:11:14.503707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 251/500] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:14 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:14.630032 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:14.631341 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:14.637505 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:14.638208 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:14.638645 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:14.639376 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:14.639833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:14.640263 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:14.809677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:14.817267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-99f2b5e0-7b4c-4cfc-85b7-2fa856fbd707 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.190960 Sep 22 17:11:14.817833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 250/501] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:14 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:15.391348 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:15.392107 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:15.398303 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:15.398789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:15.399243 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:15.400420 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:15.400863 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:15.401275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:15.528290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:15.530527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:15.538431 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:15.538919 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:15.539385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:15.540832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:15.541292 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:15.541718 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:15.602098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:15.611942 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:15.614812 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:15.616110 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-16f7a057-cc8c-4834-b97c-2e3e52bb988d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.228733 Sep 22 17:11:15.617538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 252/502] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:15 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:15.783040 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:15.791960 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a505ea7a-4913-4aa3-839c-79fdb0e10415 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.269386 Sep 22 17:11:15.792537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 251/503] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:15 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:15.842192 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:15.843107 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:15.852108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:15.852763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:15.853299 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:15.854116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:15.854690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:15.855435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:16.009747 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:16.017984 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f04445d6-453b-4d45-8372-56918be5fdca tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.180803 Sep 22 17:11:16.018850 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 253/504] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:15 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:16.643810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:16.644577 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:16.651152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:16.651912 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:16.652537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:16.653293 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:16.653750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:16.654195 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:16.823688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:16.825559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:16.841292 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:16.852112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:16.853240 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:16.853681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:16.854389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:16.854838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:16.855287 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:16.861005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:16.862482 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:16.863734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d5bd2c65-72c5-458c-b31a-d40dcc2935d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.224017 Sep 22 17:11:16.864313 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 252/505] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:16 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:17.036378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:17.042152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:17.042857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:17.051308 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:17.051946 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:17.052458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:17.053253 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:17.053778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:17.053997 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-09a4bc1c-b967-4402-b1fc-04b238b11e06 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.237661 Sep 22 17:11:17.054389 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:17.069961 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 254/506] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:16 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:17.209185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:17.217954 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-98a5eaae-8f5a-47c7-b86e-cec53f11a800 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1318 microversion: 2.1 time: 0.180805 Sep 22 17:11:17.231816 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 253/507] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:17 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:17.890027 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:17.890628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:17.896993 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:17.897487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:17.897932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:17.898855 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:17.899953 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:17.900380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:18.058369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:18.068710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:18.070365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:18.074111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c5c86ac1-19d3-4c4d-bd18-81843f8f8392 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.188107 Sep 22 17:11:18.086483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:18.087940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 255/508] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:17 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:18.089487 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:18.111116 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:18.111894 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:18.112469 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:18.113675 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:18.114491 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:18.116150 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:18.247855 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:18.249025 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:18.255696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:18.256447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:18.257027 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:18.257908 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:18.259469 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:18.260410 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:18.328757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:18.345357 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6a0f4083-5c65-4dea-a4fe-cdc908f4d99f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.270864 Sep 22 17:11:18.358870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 254/509] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:18 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:18.448259 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:18.457614 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9ba92955-f944-4b01-9d8f-92bf5e10480a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1506 microversion: 2.1 time: 0.218445 Sep 22 17:11:18.466677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 256/510] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:18 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:18.482882 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-83611f6d-0d45-48ef-822a-fc15f89859b6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d86af7f8-73e7-4e32-96e3-0b8fab9103da", "device": "/dev/sdb"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:18.485901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-83611f6d-0d45-48ef-822a-fc15f89859b6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:18.495715 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83611f6d-0d45-48ef-822a-fc15f89859b6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:18.496343 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83611f6d-0d45-48ef-822a-fc15f89859b6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:18.497071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83611f6d-0d45-48ef-822a-fc15f89859b6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:18.498112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83611f6d-0d45-48ef-822a-fc15f89859b6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:18.498842 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83611f6d-0d45-48ef-822a-fc15f89859b6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:18.499376 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83611f6d-0d45-48ef-822a-fc15f89859b6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:18.887890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-83611f6d-0d45-48ef-822a-fc15f89859b6 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "POST /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409938 Sep 22 17:11:18.890204 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 255/511] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:11:18 2022] POST /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:11:19.112588 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:19.113827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:19.126040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:19.128205 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:19.129145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:19.130854 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:19.131740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:19.132563 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:19.379874 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:19.381185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:19.389760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:19.404814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:19.405292 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:19.413836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:19.416748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:19.417591 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:19.417955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:19.418840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:19.419634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:19.425494 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-79f51296-0f9a-424d-97b4-ba32912f7509 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.320521 Sep 22 17:11:19.426769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 257/512] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:19 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:19.644823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:19.654607 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e9e81687-044f-4916-ba95-e5cf9eea1b6f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.283935 Sep 22 17:11:19.655683 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 256/513] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:19 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:20.471217 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:20.471983 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:20.483601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:20.484202 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:20.484888 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:20.485484 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:20.485967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:20.486383 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:20.606169 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-24621fc8-63a6-4694-88b5-3c1296ccf4b2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:20.607416 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-24621fc8-63a6-4694-88b5-3c1296ccf4b2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:20.617169 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24621fc8-63a6-4694-88b5-3c1296ccf4b2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:20.618665 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24621fc8-63a6-4694-88b5-3c1296ccf4b2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:20.618865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24621fc8-63a6-4694-88b5-3c1296ccf4b2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:20.621083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24621fc8-63a6-4694-88b5-3c1296ccf4b2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:20.621810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24621fc8-63a6-4694-88b5-3c1296ccf4b2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:20.623377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-24621fc8-63a6-4694-88b5-3c1296ccf4b2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:20.651280 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-24621fc8-63a6-4694-88b5-3c1296ccf4b2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/ips" status: 200 len: 149 microversion: 2.1 time: 0.048888 Sep 22 17:11:20.652358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 257/514] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:11:20 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:11:20.683544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:20.684499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:20.684955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:20.695935 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:20.698287 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:20.699874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e13fedb8-30aa-4224-9fa0-3db1a81e9280 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.233588 Sep 22 17:11:20.705331 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 258/515] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:20 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:20.711315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:20.713396 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:20.714321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:20.716432 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:20.717282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:20.717954 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:20.995842 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:21.016853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-00947433-97a1-40c0-ac1c-fa37eb8162e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.338749 Sep 22 17:11:21.018720 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 258/516] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:20 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:21.741523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:21.745506 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:21.757765 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:21.759438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:21.760517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:21.761897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:21.762799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:21.763581 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:22.013162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:22.022082 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:22.023635 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:22.024898 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-aa2ecaa2-889c-4af6-8362-603c632902b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.290704 Sep 22 17:11:22.025654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 259/517] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:21 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:22.044040 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:22.045611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:22.048487 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=54 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:22.065528 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:22.066034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:22.066478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:22.067227 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:22.067686 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:22.068111 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:22.277915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:22.287343 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9cd3ce83-2546-40ae-925d-9ef813df385e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.248065 Sep 22 17:11:22.287857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 259/518] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:22 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:23.060114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:23.061261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:23.073463 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:23.074643 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:23.075945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:23.077683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:23.079166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:23.080948 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:23.337391 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:23.338765 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:23.361510 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:23.362276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:23.362819 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:23.365711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:23.366451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:23.367497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:23.409679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:23.419713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:23.432126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:23.436505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8d256643-8f85-4e19-be4f-1016c7e322c5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.387021 Sep 22 17:11:23.437239 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 260/519] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:23 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:23.518516 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e9bed1e1-4c48-4a0c-a1b5-370d3fe5c275 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcad51fd-ddfd-42f6-97db-7b12fcde8bfd"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:23.521405 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e9bed1e1-4c48-4a0c-a1b5-370d3fe5c275 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:23.529484 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9bed1e1-4c48-4a0c-a1b5-370d3fe5c275 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:23.530284 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9bed1e1-4c48-4a0c-a1b5-370d3fe5c275 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:23.530974 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9bed1e1-4c48-4a0c-a1b5-370d3fe5c275 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:23.531922 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9bed1e1-4c48-4a0c-a1b5-370d3fe5c275 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:23.532968 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9bed1e1-4c48-4a0c-a1b5-370d3fe5c275 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:23.533617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e9bed1e1-4c48-4a0c-a1b5-370d3fe5c275 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:23.559489 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:23.901435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:23.938221 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-43fa2bd7-4fa1-4ebf-8228-f992d6fe7965 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.606474 Sep 22 17:11:23.963727 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 260/520] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:23 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:24.157598 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e9bed1e1-4c48-4a0c-a1b5-370d3fe5c275 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643387 Sep 22 17:11:24.161180 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 261/521] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:11:23 2022] POST /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:11:24.489203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:24.490110 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:24.504463 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:24.505682 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:24.506145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:24.514345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:24.515077 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:24.515836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:24.972912 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:24.974468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:24.983827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:24.985100 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:24.985706 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:24.986590 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:24.987245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:24.987821 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:25.181433 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:25.186109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:25.198143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:25.202812 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:25.208342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c8b36ddd-1568-4e30-9d0d-ba9487126bb3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.726171 Sep 22 17:11:25.209558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 261/522] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:24 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:25.288950 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:25.316012 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7951ac1f-d18b-4d70-b13d-79eaa3464932 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.343470 Sep 22 17:11:25.317322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 262/523] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:24 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:26.239917 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:26.240918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:26.263891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:26.265729 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:26.267239 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:26.268283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:26.268982 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:26.269612 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:26.356796 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:26.363993 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:26.394116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:26.396144 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:26.396892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:26.398059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:26.399419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:26.400596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:26.549822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:26.564552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:26.567692 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:26.569558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7b327c43-6a97-415d-b2c5-98efc3896f61 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.336468 Sep 22 17:11:26.585732 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 262/524] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:26 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:26.682303 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:26.707320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-15dc9c50-52b0-49fd-9679-bbf16a15e329 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1723 microversion: 2.1 time: 0.369738 Sep 22 17:11:26.708891 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 263/525] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:26 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:27.599759 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:27.600671 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:27.608985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:27.609824 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:27.610973 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:27.613033 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:27.613907 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:27.614784 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:27.815154 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9f95e120-553b-4856-8b97-8972e67e7795 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Action: 'create', calling method: .version_select at 0x7f51d93f8dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-880029579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpRPPm8S2eb6knE+a3vNvL9dFU7AhIyIUnlxT1KBVN1aZRUSjg0cquJcBS6ydEckZ+cYdmup4n3ZZ8b4RQqXMCUB+MCFyc24Rc2mLwHpeGjUGWIidJSG1hdv5T+UB2nng=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:27.850893 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-9f95e120-553b-4856-8b97-8972e67e7795 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Getting quotas for project 5fca6eabbca24bc09aee7e259ca82562. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:11:27.856330 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-9f95e120-553b-4856-8b97-8972e67e7795 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Getting quotas for user c2060b33d0a24e01a96ab3fb02b4b045 and project 5fca6eabbca24bc09aee7e259ca82562. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:11:27.893946 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9f95e120-553b-4856-8b97-8972e67e7795 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.436281 Sep 22 17:11:27.895075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 263/526] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:11:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:11:27.904982 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:27.918253 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:27.919742 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:27.926249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:27.930515 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:27.933957 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f3698710-de3d-4454-986a-5715e0c3d5f9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.338108 Sep 22 17:11:27.935224 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 264/527] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:27 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:11:27.949491 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:27.955884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:27.957837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:27.959109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:27.959587 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:27.960014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:28.216613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:28.225953 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6ffa237b-76e4-4ebd-b371-956cfda2d62f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1700 microversion: 2.1 time: 0.329220 Sep 22 17:11:28.226552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 264/528] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:27 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1700 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:28.249663 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-36f159da-984b-4086-b9bc-e6f80e992b12 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:28.255882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-36f159da-984b-4086-b9bc-e6f80e992b12 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:28.256377 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-36f159da-984b-4086-b9bc-e6f80e992b12 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:28.256812 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-36f159da-984b-4086-b9bc-e6f80e992b12 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:28.325777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-36f159da-984b-4086-b9bc-e6f80e992b12 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Going to try to start instance {{(pid=120804) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 22 17:11:28.394603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-36f159da-984b-4086-b9bc-e6f80e992b12 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/action" status: 202 len: 0 microversion: 2.1 time: 0.148650 Sep 22 17:11:28.395346 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 265/529] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:11:28 2022] POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:11:28.404930 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:28.405610 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:28.440614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:28.442371 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:28.442845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:28.443658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:28.444621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:28.445185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:28.764649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:28.775837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c2a2c061-e155-46f7-94b2-f9f86470faaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.375042 Sep 22 17:11:28.776778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 265/530] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:28 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:28.971859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:28.972558 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:28.980366 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:28.981001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:28.981534 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:28.982481 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:28.982987 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:28.983495 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:29.256623 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:29.279274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:29.282678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:29.284751 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e4eec63f-9096-4d72-ae54-2903a0e1056d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.317400 Sep 22 17:11:29.286214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 266/531] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:28 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:11:29.804020 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:29.805566 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:29.823198 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:29.824029 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:29.824973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:29.826387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:29.827298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:29.828129 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:30.048761 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:30.059364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-58e2d80f-e12a-4aa0-b829-421592a22dbc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.262764 Sep 22 17:11:30.060158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 266/532] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:29 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:30.312212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:30.312968 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:30.320282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:30.321306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:30.321746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:30.322448 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:30.323081 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:30.323504 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:30.469612 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:30.478063 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:30.479564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:30.480744 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-15ab1e61-b34f-4936-9ef6-81fec651205c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.172692 Sep 22 17:11:30.481685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 267/533] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:30 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:31.083434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:31.084774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:31.093986 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:31.094541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:31.095212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:31.095916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:31.096374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:31.096799 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:31.250593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:31.262140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d5c6919b-0b03-4317-bd17-843f7992bdaa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.181411 Sep 22 17:11:31.275891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 267/534] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:31 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:31.509715 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:31.510686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:31.519147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:31.519631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:31.520233 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:31.520965 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:31.521435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:31.522023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:31.695289 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:31.706917 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:31.708424 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:31.709613 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-163d3da3-2e3f-4493-b8a8-28b7063c72af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.205245 Sep 22 17:11:31.710184 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 268/535] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:31 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:32.286921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:32.287775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:32.294544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:32.295160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:32.295986 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:32.296413 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:32.297056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:32.297480 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:32.431243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:32.439521 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9e044e64-6f2d-45b5-9d57-7eaa335f7f0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.156475 Sep 22 17:11:32.440083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 268/536] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:32 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:32.736122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:32.736721 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:32.743834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:32.744315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:32.744749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:32.745471 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:32.745921 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:32.746399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:32.887700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:32.896567 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:32.898194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:32.899895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f0b99928-39fb-43e0-ad30-585292a56200 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.167766 Sep 22 17:11:32.900493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 269/537] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:32 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:11:33.467147 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:33.468399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:33.475994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:33.476486 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:33.476950 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:33.477652 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:33.478106 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:33.478526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:33.618602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:33.627041 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4b141a52-06fa-41c2-a9d2-93c46be97c87 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.167944 Sep 22 17:11:33.627615 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 269/538] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:33 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:33.926129 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:33.926712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:33.938063 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:33.939436 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:33.940479 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:33.942362 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:33.943814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:33.945590 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:34.092706 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:34.100097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:34.101541 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:34.103357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-32ed2ce5-0c55-4d3c-bb0f-9cf760964eee tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.181648 Sep 22 17:11:34.103913 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 270/539] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:33 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:34.656160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:34.656688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:34.664086 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:34.664687 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:34.665217 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:34.665823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:34.666211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:34.666638 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:34.811225 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:34.819266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3bd71d97-a4b6-4e62-ae74-cbc37ccc4fe5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.168313 Sep 22 17:11:34.819831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 270/540] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:34 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:35.128154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:35.128762 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:35.136330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:35.136820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:35.137246 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:35.138342 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:35.138777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:35.139216 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:35.288944 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:35.298174 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:35.299914 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:35.301072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9b69a9a7-942c-487c-b712-65a59d1c542b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.177047 Sep 22 17:11:35.301634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 271/541] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:35 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:35.843382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:35.843932 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:35.850808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:35.851320 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:35.852409 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:35.853104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:35.853557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:35.853980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:36.005267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:36.014259 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ab615733-74fa-4bca-8867-3dc241dfa68e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.174839 Sep 22 17:11:36.014879 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 271/542] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:35 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:36.330140 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:36.330761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:36.338676 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:36.339201 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:36.339642 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:36.340346 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:36.340799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:36.341220 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:36.511167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:36.520403 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:36.522112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:36.523307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fbcbe55d-f759-4b58-9136-f872ea152cdd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.197547 Sep 22 17:11:36.523905 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 272/543] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:36 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:11:37.038789 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:37.039985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:37.047033 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:37.047524 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:37.047963 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:37.048656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:37.049115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:37.049808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:37.182277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:37.190803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-90dc9342-ee48-47a1-b07e-83c738b96156 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.155822 Sep 22 17:11:37.191564 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 272/544] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:37 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:37.549966 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:37.550474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:37.557461 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:37.558218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:37.558972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:37.560041 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:37.560707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:37.561405 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:37.701934 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:37.710034 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:37.712115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:37.713259 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6427f46d-0f1b-4bf5-b53b-737a093d0af2 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.167525 Sep 22 17:11:37.713815 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 273/545] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:37 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:38.214239 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:38.214853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:38.218086 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=4 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:38.223293 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:38.223797 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:38.224317 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:38.225099 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:38.225590 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:38.226013 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:38.363270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:38.372471 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c574945c-9cb8-4ebf-90a5-fcd9d8237f41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.161997 Sep 22 17:11:38.373126 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 273/546] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:38 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:38.738128 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:38.738734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:38.745164 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:38.745643 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:38.746075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:38.746760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:38.747236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:38.747659 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:38.875846 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:38.884510 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:38.885950 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:38.887142 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cc5f4b3f-2a26-4c95-a0c4-d474463ee0e1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.152882 Sep 22 17:11:38.887698 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 274/547] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:38 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:39.396079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:39.396681 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:39.403547 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:39.404026 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:39.404453 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:39.405133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:39.405607 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:39.406022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:39.548023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:39.557528 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-62ece06d-d87a-419a-83ac-1cbcf2b5cfe2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.165365 Sep 22 17:11:39.558109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 274/548] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:39 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:39.918006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:39.918552 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:39.920967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=60 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:39.926631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:39.927150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:39.927576 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:39.928256 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:39.928697 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:39.929110 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:40.066779 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:40.069357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:40.077778 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:40.079271 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:40.080515 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8c4216f5-45b6-4826-9f79-7997dc8de993 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.166768 Sep 22 17:11:40.081120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 275/549] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:39 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:40.580722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:40.581335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:40.587855 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:40.588339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:40.588775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:40.589463 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:40.589922 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:40.590342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:40.727406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:40.735737 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a323ec62-fd17-41f6-85f7-bc18c61723dc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.158838 Sep 22 17:11:40.736311 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 275/550] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:40 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:41.108692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:41.109298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:41.116681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:41.117167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:41.117604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:41.118355 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:41.118809 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:41.119283 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:41.260337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:41.270921 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:41.272406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:41.274220 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-672ca272-41a0-42b1-8c58-e510a5d79084 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.169611 Sep 22 17:11:41.274834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 276/551] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:41 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:41.762063 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:41.763447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:41.770164 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:41.770653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:41.771135 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:41.771842 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:41.772295 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:41.772715 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:41.906749 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:41.915740 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4733e961-a008-4425-a03b-0e43661a7e13 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.158689 Sep 22 17:11:41.916294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 276/552] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:41 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:42.300301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:42.300906 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:42.307415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:42.308124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:42.308567 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:42.309257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:42.309712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:42.310136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:42.448492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:42.457260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:42.458712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:42.459892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8bfafea1-68dd-4a04-9a4a-6d8058527d64 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.163966 Sep 22 17:11:42.460452 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 277/553] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:42 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:42.939661 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:42.940679 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:42.948415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:42.949163 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:42.950111 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:42.951583 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:42.952496 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:42.953467 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:43.105479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:43.113845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e068074a-23d2-4139-abfa-37784d84978d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.178614 Sep 22 17:11:43.114414 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 277/554] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:42 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:43.485034 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:43.485633 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:43.492217 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:43.492777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:43.493287 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:43.494297 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:43.495044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:43.495477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:43.635687 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:43.644128 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:43.645433 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:43.646662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8ca91cc3-02de-4ffa-8e6b-62156f915d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.165518 Sep 22 17:11:43.647141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 278/555] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:43 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:44.138540 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:44.139173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:44.145513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:44.145985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:44.146412 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:44.147114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:44.147558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:44.147970 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:44.284123 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:44.293022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3b4aded6-5a8e-4932-a436-10a09a34c659 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.159121 Sep 22 17:11:44.293597 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 278/556] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:44 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:44.671547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:44.672156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:44.679262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:44.679777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:44.680210 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:44.680916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:44.681361 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:44.681781 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:44.742562 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d8ea1861-d69e-489e-9c18-c9d1c587c00f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: .version_select at 0x7f51d9605c10>, body: {"keypair": {"name": "tempest-keypair-732043597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHhJMPw1v5N4P/l76WgnYiEk0y//QperTzl7HYTOcwuNaiWltSRs1Fep1xU9N5KDIjOSqoR9b13zhUMVCqRc1xDJ4ROgSQZ6C/g36Ry8GA2BjmY1CCaqQH6ykCqWL/u8g=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:44.762099 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-d8ea1861-d69e-489e-9c18-c9d1c587c00f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:11:44.767188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-d8ea1861-d69e-489e-9c18-c9d1c587c00f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for user 5feea3b3b7e4401ea7db242cb60fdfcc and project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:11:44.793242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d8ea1861-d69e-489e-9c18-c9d1c587c00f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055214 Sep 22 17:11:44.794023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 279/557] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:11:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:11:44.823965 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:44.832912 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:44.834474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:44.836339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3889f1b3-b652-4fa9-afc5-ab5f5fd2322f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1743 microversion: 2.20 time: 0.168100 Sep 22 17:11:44.842570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 279/558] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:44 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:45.318351 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:45.318983 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:45.325677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:45.326501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:45.326995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:45.327704 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:45.328158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:45.328585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:45.351118 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:45.483505 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:45.494276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3012163f-e759-40d8-b634-4b3af8f4e872 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1709 microversion: 2.1 time: 0.180189 Sep 22 17:11:45.495356 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 280/559] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:45 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1709 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:45.861727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:45.862339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:45.871892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:45.872485 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:45.873000 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:45.873703 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:45.874162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:45.878627 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:46.027390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:46.035858 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:46.037857 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:46.039786 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-92f89eb5-31e7-41c3-ada5-4ff5900596f6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1743 microversion: 2.20 time: 0.181816 Sep 22 17:11:46.047984 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 280/560] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:45 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:46.186088 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:46.186769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:46.192857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:46.193345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:46.193818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:46.194484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:46.194997 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:46.195984 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:46.207150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1328424558", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82eac7a2-877a-48c4-bcb2-cd10274854a5"}], "security_groups": [{"name": "tempest-securitygroup--1767466394"}], "key_name": "tempest-keypair-732043597", "user_data": "}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:46.327389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] validate_networks() for [('82eac7a2-877a-48c4-bcb2-cd10274854a5', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:11:46.334181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lazy-loading 'services' on Instance uuid f58f33b8-4007-4029-8727-568bbd91beb5 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:11:46.461682 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ddc49488-7f6a-4c3d-804c-1c904cbec888 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5/os-volume_attachments/d86af7f8-73e7-4e32-96e3-0b8fab9103da" status: 202 len: 0 microversion: 2.1 time: 0.279947 Sep 22 17:11:46.462515 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 281/561] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:11:46 2022] DELETE /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5/os-volume_attachments/d86af7f8-73e7-4e32-96e3-0b8fab9103da => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:11:46.531266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:46.532345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:46.541289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:46.541917 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:46.542360 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:46.543100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:46.543522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:46.543968 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:46.766434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:46.775601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f59ece70-1253-4883-8897-a7719ee9742d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1713 microversion: 2.1 time: 0.256085 Sep 22 17:11:46.776250 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 282/562] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:46 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1713 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:46.815920 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:11:46.816337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:11:46.816804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:11:46.817209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:11:46.817616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:11:46.826341 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:46.826808 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:46.827369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:46.828183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:46.828665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:46.829263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:46.847491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:11:46.851631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for user 5feea3b3b7e4401ea7db242cb60fdfcc and project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:11:46.862705 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:11:46.865200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:11:46.913388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-704d3b60-7d05-438f-912c-f6cdb1167f75 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.710529 Sep 22 17:11:46.914053 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 281/563] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:11:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 17:11:46.926483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-de051cbe-4737-4ee1-8a3f-5629a9b8ed1f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:46.927259 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-de051cbe-4737-4ee1-8a3f-5629a9b8ed1f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:46.986030 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-de051cbe-4737-4ee1-8a3f-5629a9b8ed1f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:46.993013 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-de051cbe-4737-4ee1-8a3f-5629a9b8ed1f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1241 microversion: 2.1 time: 0.070733 Sep 22 17:11:46.993937 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 283/564] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:46 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:47.065605 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:47.066303 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:47.073345 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:47.073911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:47.074421 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:47.075224 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:47.075777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:47.076273 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:47.214401 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:47.224841 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:47.226323 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:47.227605 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-405d4bbb-99b5-4394-abbb-4ee46991714b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1743 microversion: 2.20 time: 0.166008 Sep 22 17:11:47.228161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 282/565] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:47 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:47.717369 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-109fd0c4-c74b-45c5-85f3-09f4701458e1 req-98935bb6-89a9-472d-b325-a92bcb7667bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2", "name": "network-vif-plugged", "status": "completed", "tag": "9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:47.733997 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-109fd0c4-c74b-45c5-85f3-09f4701458e1 req-98935bb6-89a9-472d-b325-a92bcb7667bb service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:47.734508 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-109fd0c4-c74b-45c5-85f3-09f4701458e1 req-98935bb6-89a9-472d-b325-a92bcb7667bb service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:47.735017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-109fd0c4-c74b-45c5-85f3-09f4701458e1 req-98935bb6-89a9-472d-b325-a92bcb7667bb service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:47.747197 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-109fd0c4-c74b-45c5-85f3-09f4701458e1 req-98935bb6-89a9-472d-b325-a92bcb7667bb service nova] Creating event network-vif-plugged:9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea for instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 on hv-cinder-83538 Sep 22 17:11:47.759469 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-109fd0c4-c74b-45c5-85f3-09f4701458e1 req-98935bb6-89a9-472d-b325-a92bcb7667bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045952 Sep 22 17:11:47.760640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 284/566] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:11:48.015430 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:48.016098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:48.023720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:48.024404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:48.024833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:48.025526 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:48.025973 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:48.026388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:48.091886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:48.102771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0c70c967-226d-41d9-a288-c50c31a81019 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1293 microversion: 2.1 time: 0.091042 Sep 22 17:11:48.103529 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 283/567] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:48 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:48.254276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:48.254999 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:48.262522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:48.263364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:48.263910 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:48.264846 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:48.265492 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:48.266027 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:48.399954 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:48.408243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:48.409685 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:48.410840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c4c6aa76-65fe-4e5c-8cb9-6a12598dcdca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1743 microversion: 2.20 time: 0.160900 Sep 22 17:11:48.411456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 285/568] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:48 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:48.666069 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:48.666586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:48.673837 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:48.674666 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:48.675196 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:48.675957 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:48.676411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:48.676842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:48.705156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:11:48.794502 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6967224a-fd35-44f3-ad93-f04d2e7ec73a tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 204 len: 0 microversion: 2.1 time: 0.131948 Sep 22 17:11:48.795215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 284/569] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:11:48 2022] DELETE /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:11:48.805312 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:48.806048 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:48.813349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:48.814070 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:48.814633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:48.815761 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:48.816351 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:48.817107 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:48.953136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:48.962443 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3bcd35fd-e600-4841-995b-632c11c17b0d tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1512 microversion: 2.1 time: 0.160673 Sep 22 17:11:48.963065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 286/570] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:48 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:49.126746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:49.127464 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:49.133827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:49.134325 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:49.134755 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:49.135456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:49.135900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:49.136311 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:49.198645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:49.206381 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9e6de8f7-23f5-4f46-a87e-15fd71e029da tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1299 microversion: 2.1 time: 0.083768 Sep 22 17:11:49.206969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 285/571] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:49 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:49.437983 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:49.438636 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:49.444615 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:49.445591 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:49.446022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:49.446757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:49.447186 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:49.447610 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:49.575123 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:49.583451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:49.584960 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:49.586705 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f07a79a4-a8bf-4ab8-aaeb-f25ebd0a75ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1743 microversion: 2.20 time: 0.152663 Sep 22 17:11:49.587292 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 287/572] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:49 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:49.985559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:49.986099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:49.992993 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:49.993478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:49.993911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:49.994605 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:49.995086 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:49.995514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:50.133971 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:50.141565 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a0451b77-8231-4a56-a82b-d172278f61ea tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1512 microversion: 2.1 time: 0.160236 Sep 22 17:11:50.142142 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 286/573] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:49 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:50.230006 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:50.230647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:50.237133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:50.237614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:50.238049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:50.238739 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:50.239219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:50.239644 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:50.302860 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:50.311062 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-272e2274-a72e-4468-8e8b-e38914948ac9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1299 microversion: 2.1 time: 0.085430 Sep 22 17:11:50.311639 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 288/574] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:50 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:50.613141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:50.613678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:50.619735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:50.620216 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:50.620650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:50.621338 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:50.621793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:50.622221 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:50.805789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:50.815113 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:50.816747 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:50.817942 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-748c1ee8-299c-46f1-8155-fa41c26d57b4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1743 microversion: 2.20 time: 0.208833 Sep 22 17:11:50.818505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 287/575] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:50 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1743 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:51.166211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:51.167066 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:51.173257 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:51.174586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:51.174745 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:51.175519 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:51.176367 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:51.177031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:51.334096 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:51.334599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:51.342079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:51.342572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:51.343046 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:51.343761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:51.344217 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:51.344677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:51.375302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:51.383420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-09f93088-7fc5-431d-a5ef-d6e974193f6f tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1512 microversion: 2.1 time: 0.222045 Sep 22 17:11:51.384014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 289/576] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:51 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:51.419009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:51.428582 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f64819ad-b09e-424a-84f9-4a837b398648 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1299 microversion: 2.1 time: 0.098532 Sep 22 17:11:51.437347 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 288/577] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:51 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:11:51.851966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:51.852931 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:51.859914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:51.860680 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:51.861225 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:51.862031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:51.862620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:51.863151 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:52.093643 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:52.108422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:52.109969 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:52.115926 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1eba9aed-a80e-4fc7-b728-41b27a27a4d1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1743 microversion: 2.20 time: 0.263842 Sep 22 17:11:52.116408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 290/578] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:51 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1743 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:11:52.352516 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-05417169-79da-4561-8e6d-76ac4d4abf5b req-5dfa1c8e-2c46-4d9c-a094-1050b9c2209a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58f33b8-4007-4029-8727-568bbd91beb5", "name": "network-vif-deleted", "tag": "c1027e91-59c4-4455-a230-d405860c4e3a"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:52.364298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-05417169-79da-4561-8e6d-76ac4d4abf5b req-5dfa1c8e-2c46-4d9c-a094-1050b9c2209a service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:52.364780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-05417169-79da-4561-8e6d-76ac4d4abf5b req-5dfa1c8e-2c46-4d9c-a094-1050b9c2209a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:52.365211 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-05417169-79da-4561-8e6d-76ac4d4abf5b req-5dfa1c8e-2c46-4d9c-a094-1050b9c2209a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:52.380197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-05417169-79da-4561-8e6d-76ac4d4abf5b req-5dfa1c8e-2c46-4d9c-a094-1050b9c2209a service nova] Creating event network-vif-deleted:c1027e91-59c4-4455-a230-d405860c4e3a for instance f58f33b8-4007-4029-8727-568bbd91beb5 on hv-cinder-83538 Sep 22 17:11:52.386405 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-05417169-79da-4561-8e6d-76ac4d4abf5b req-5dfa1c8e-2c46-4d9c-a094-1050b9c2209a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039459 Sep 22 17:11:52.387098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 289/579] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:11:52.409509 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:52.410123 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:52.414373 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:52.416439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-bbe1fceb-20ab-426e-a5b2-6646d10434ff req-a5633a10-3433-4862-ae66-6289736e84fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae76e1d7-dddd-4528-979a-025f671185aa", "tag": "a525dbad-0b77-49f5-92d5-87d346a4de53"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:11:52.424424 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:52.425143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:52.425766 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:52.426646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:52.427320 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:52.427886 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:52.430090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-bbe1fceb-20ab-426e-a5b2-6646d10434ff req-a5633a10-3433-4862-ae66-6289736e84fa service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:52.430581 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-bbe1fceb-20ab-426e-a5b2-6646d10434ff req-a5633a10-3433-4862-ae66-6289736e84fa service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:52.431131 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-bbe1fceb-20ab-426e-a5b2-6646d10434ff req-a5633a10-3433-4862-ae66-6289736e84fa service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:52.448826 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-bbe1fceb-20ab-426e-a5b2-6646d10434ff req-a5633a10-3433-4862-ae66-6289736e84fa service nova] Creating event network-changed:a525dbad-0b77-49f5-92d5-87d346a4de53 for instance ae76e1d7-dddd-4528-979a-025f671185aa on hv-cinder-83538 Sep 22 17:11:52.456646 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-bbe1fceb-20ab-426e-a5b2-6646d10434ff req-a5633a10-3433-4862-ae66-6289736e84fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043752 Sep 22 17:11:52.457831 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 290/580] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:11:52.465022 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:52.466397 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:52.475733 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:52.476831 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:52.477266 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:52.477967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:52.478441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:52.478873 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:52.527068 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4386cce77ec047f480e9999aeb103da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cce6768e1a473f9056d179b605df6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:52.556055 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5ef4ee74-2e02-4b3d-b567-20146f8bc9bd tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 200 len: 1303 microversion: 2.1 time: 0.151374 Sep 22 17:11:52.557231 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 291/581] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:52 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:52.975299 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:52.984254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-eb47c9e9-6dd3-4376-9a59-733088a2c2e2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.524933 Sep 22 17:11:52.985897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 291/582] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:52 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:53.153781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:53.155707 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:53.162131 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:53.162620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:53.163155 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:53.164104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:53.164795 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:53.165281 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:53.426671 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:53.440796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:53.442620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:53.447925 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-515d5083-113f-4082-8ad2-55d81c6b441a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.301240 Sep 22 17:11:53.449265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 292/583] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:53 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:11:53.581555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:53.582173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] [instance: f58f33b8-4007-4029-8727-568bbd91beb5] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:53.589576 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:53.590056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:53.590488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:53.591213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:53.591661 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:53.592077 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:53.610324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] HTTP exception thrown: Instance f58f33b8-4007-4029-8727-568bbd91beb5 could not be found. Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Request method failure captured: Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 HTTP/1.1 Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJaVpgiztDwmXzkgEyH961px0NYGUoVfsl-GoGS-riAU8vAtcvfYFtLOy781YWynmxoi6w_7eoJfzo0R-JKwc6FunjCascJQzPCGqij-uxBevorHirzzyqgk82uNBYq1HqTHS_tV_r2zgRmpiXqyHWMpPgO7SZ6q_VvOLIjm6bwEm2E Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 78cce6768e1a473f9056d179b605df6d Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1263262637 Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:11:53.612324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78cce6768e1a473f9056d179b605df6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78cce6768e1a473f9056d179b605df6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/78cce6768e1a473f9056d179b605df6d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_78cce6768e1a473f9056d179b605df6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-VolumesSnapshotTestJSON-1263262637 Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 78cce6768e1a473f9056d179b605df6d Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1263262637 Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-VolumesSnapshotTestJSON-1263262637-project Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 4386cce77ec047f480e9999aeb103da5 Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-VolumesSnapshotTestJSON-1263262637-project Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance f58f33b8-4007-4029-8727-568bbd91beb5 could not be found. Sep 22 17:11:53.613949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': 'f58f33b8-4007-4029-8727-568bbd91beb5'} Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f58f33b8-4007-4029-8727-568bbd91beb5 could not be found. Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:11:53.614830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f58f33b8-4007-4029-8727-568bbd91beb5 could not be found. Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f58f33b8-4007-4029-8727-568bbd91beb5 could not be found. Sep 22 17:11:53.617474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:11:53.619966 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] Returning 404 to user: Instance f58f33b8-4007-4029-8727-568bbd91beb5 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:11:53.619966 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4b757de1-2b7c-4af8-b6c2-60c1e16014f5 tempest-VolumesSnapshotTestJSON-1263262637 tempest-VolumesSnapshotTestJSON-1263262637-project] 10.222.0.16 "GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5" status: 404 len: 111 microversion: 2.1 time: 0.036762 Sep 22 17:11:53.619966 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 292/584] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:53 2022] GET /compute/v2.1/servers/f58f33b8-4007-4029-8727-568bbd91beb5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:11:54.009801 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:54.010417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:54.017073 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:54.017559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:54.018040 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:54.018757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:54.019236 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:54.019666 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:54.178248 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:54.188383 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-83989821-1a3a-4adb-be05-43e7a18de122 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.182997 Sep 22 17:11:54.189185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 293/585] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:54 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:54.475322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:54.477848 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:54.484008 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:54.484635 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:54.485073 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:54.485780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:54.486219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:54.487259 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:54.505442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:54.635348 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:54.643793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:54.645299 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:54.646667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d493c51e-59b3-459a-8e77-ecb22e03f005 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.175804 Sep 22 17:11:54.647249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 293/586] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:54 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:55.213914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:55.215257 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:55.227968 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:55.229536 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:55.230401 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:55.231477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:55.232062 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:55.232595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:55.447165 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:55.455407 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-77c3474e-987c-4af4-a77f-137b1ae992df tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.245633 Sep 22 17:11:55.456666 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 294/587] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:55 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:55.672843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:55.674525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:55.682560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:55.683381 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:55.683867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:55.684570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:55.685017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:55.685434 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:55.820234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:55.828427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:55.829918 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:55.831164 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c4eedea3-cc84-4b87-9ce0-cf6089cb9048 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.162223 Sep 22 17:11:55.831760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 294/588] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:55 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:56.482347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:56.482970 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:56.490150 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:56.490840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:56.491311 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:56.492021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:56.492472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:56.493181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:56.663700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:56.673718 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aae91970-80c0-4ac2-9729-adb5bb762a4d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.197611 Sep 22 17:11:56.674981 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 295/589] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:56 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:56.857844 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:56.859147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:56.861704 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:56.862376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:56.869163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:56.869654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:56.870988 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:56.870988 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:56.871343 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:56.871761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:57.062412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:57.078910 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:57.082015 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:57.084417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-651c04a4-8393-4d65-af0b-4b2aa0d6db8a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.230341 Sep 22 17:11:57.086037 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 295/590] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:56 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:57.702089 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:57.703028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:57.708808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:11:57.712707 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:57.713520 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:57.714231 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:57.715273 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:57.716388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:57.716975 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:57.906482 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:57.921976 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8adb3c89-25eb-4b4b-b684-8f7ef267e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.225190 Sep 22 17:11:57.923366 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 296/591] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:57 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:58.114274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:58.114853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:58.126478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:58.127360 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:58.127974 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:58.128918 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:58.129376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:58.129838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:58.322975 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:58.331696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:58.333352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:58.334687 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c57d246b-e197-4f76-a59c-da1678323ac5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.224800 Sep 22 17:11:58.336285 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 296/592] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:58 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:11:58.948270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:58.949016 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:58.956350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:58.957104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:58.957532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:58.958248 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:58.958837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:58.959294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:59.112163 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:59.121563 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b0825291-91bf-47a8-ae93-cbef07579cef tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.178220 Sep 22 17:11:59.122413 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 297/593] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:11:58 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:11:59.369664 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:11:59.371044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:11:59.380900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:59.389572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:59.389572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:59.391940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:11:59.391940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:11:59.391940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:11:59.578426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:59.597545 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:59.603914 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:11:59.605729 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7250f9a6-3254-44a7-b983-b5de4f9234ad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.240324 Sep 22 17:11:59.626333 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 297/594] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:11:59 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:00.148590 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:00.149200 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:00.157426 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:00.158070 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:00.158543 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:00.159394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:00.159851 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:00.160274 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:00.165065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:00.346136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:00.358250 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7dbd6cae-eb21-4c9b-986b-8c2ddfd47f2e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.214082 Sep 22 17:12:00.371181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 298/595] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:00 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:00.634157 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:00.634985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:00.642818 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:00.643369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:00.644027 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:00.645198 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:00.645656 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:00.646082 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:00.820598 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:00.830387 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:00.831913 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:00.833093 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a838e47d-0c9d-49bb-8fb1-37b0dffecf36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.203548 Sep 22 17:12:00.833886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 298/596] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:00 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:01.382660 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:01.383280 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:01.389689 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:01.390190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:01.390619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:01.391365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:01.391816 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:01.392234 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:01.562523 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:01.571899 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fd03b72a-c81a-463d-b649-3f13e8a2c843 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.193101 Sep 22 17:12:01.572476 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 299/597] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:01 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:01.864273 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:01.864967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:01.873015 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:01.873497 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:01.873932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:01.874822 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:01.875108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:01.875529 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:02.017326 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:02.025612 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:02.027437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:02.029161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d9085fde-ee31-44c3-8476-9b3864c871d7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.168697 Sep 22 17:12:02.029890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 299/598] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:01 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:02.602552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:02.603824 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:02.612676 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:02.613438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:02.614038 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:02.615132 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:02.615865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:02.618543 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:02.788386 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:02.796451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a96b3681-001d-4699-aced-bc1613766afa tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.199239 Sep 22 17:12:02.797291 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 300/599] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:02 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:03.056167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:03.057399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:03.064737 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:03.065217 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:03.065651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:03.066340 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:03.066785 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:03.067256 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:03.290621 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:03.299411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:03.301281 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:03.302534 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ab2228ec-7339-4a8a-93ed-9d9a3dfbebd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.250883 Sep 22 17:12:03.319861 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 300/600] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:03 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:03.821499 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:03.822253 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:03.831015 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:03.831910 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:03.832596 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:03.833302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:03.833793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:03.834472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:03.998482 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:04.006939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e93e1798-e999-448f-97d9-db279bb8ef77 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.189416 Sep 22 17:12:04.007739 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 301/601] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:03 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:04.330272 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:04.331718 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:04.339339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:04.340155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:04.340938 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:04.342142 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:04.343017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:04.343671 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:04.493559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:04.507843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:04.509279 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:04.520374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-88d2e628-0bba-4a85-b5b1-172b6d46ee15 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.194126 Sep 22 17:12:04.521247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 301/602] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:04 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:04.701063 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-8dfe9b31-a444-469b-b878-6570f49d5c65 req-76b98ad1-e9b4-4ebd-bb23-ddc793dd9f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae76e1d7-dddd-4528-979a-025f671185aa", "name": "network-vif-plugged", "status": "completed", "tag": "a525dbad-0b77-49f5-92d5-87d346a4de53"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:04.712006 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8dfe9b31-a444-469b-b878-6570f49d5c65 req-76b98ad1-e9b4-4ebd-bb23-ddc793dd9f7a service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:04.712546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8dfe9b31-a444-469b-b878-6570f49d5c65 req-76b98ad1-e9b4-4ebd-bb23-ddc793dd9f7a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:04.712988 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-8dfe9b31-a444-469b-b878-6570f49d5c65 req-76b98ad1-e9b4-4ebd-bb23-ddc793dd9f7a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:04.724809 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-8dfe9b31-a444-469b-b878-6570f49d5c65 req-76b98ad1-e9b4-4ebd-bb23-ddc793dd9f7a service nova] Creating event network-vif-plugged:a525dbad-0b77-49f5-92d5-87d346a4de53 for instance ae76e1d7-dddd-4528-979a-025f671185aa on hv-cinder-83538 Sep 22 17:12:04.730491 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-8dfe9b31-a444-469b-b878-6570f49d5c65 req-76b98ad1-e9b4-4ebd-bb23-ddc793dd9f7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 Sep 22 17:12:04.731479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 302/603] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:12:05.029572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:05.030176 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:05.036439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:05.036915 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:05.037548 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:05.038858 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:05.039335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:05.039756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:05.168523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:05.176355 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cecef5d4-9754-4d45-855c-3a41c3a64819 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.150640 Sep 22 17:12:05.176916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 302/604] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:05 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:05.548517 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:05.549724 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:05.556630 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:05.557120 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:05.558032 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:05.558727 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:05.559222 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:05.559651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:05.692226 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:05.700939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:05.702359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:05.703561 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e5a89371-5b88-4f63-8a80-8980c083458b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1738 microversion: 2.20 time: 0.159912 Sep 22 17:12:05.704128 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 303/605] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:05 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:06.199503 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:06.200108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:06.206516 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:06.207040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:06.207474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:06.208157 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:06.208599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:06.209010 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:06.347301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:06.355953 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-36f07044-40c0-4697-bf8e-67c6d43c1c3f tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.160398 Sep 22 17:12:06.356531 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 303/606] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:06 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:06.729432 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:06.730045 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:06.736670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:06.737154 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:06.737594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:06.738282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:06.738732 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:06.739215 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:06.982831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:06.991769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:06.993246 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:06.994407 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9e8accea-4e74-474f-ae94-65c804aa24aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1720 microversion: 2.20 time: 0.269078 Sep 22 17:12:06.995010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 304/607] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:06 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1720 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:07.293735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-189129140", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-880029579", "security_groups": [{"name": "tempest-secgroup-smoke-805804894"}], "block_device_mapping_v2": [{"uuid": "795f6a05-0aec-469a-afd4-632956ec2627", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1876d1ce-e761-46f2-ab46-b61110e15c2c"}]}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:07.379469 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:07.380108 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:07.405949 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:07.408179 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:07.409096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:07.409836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:07.410356 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:07.410728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:07.635435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] validate_networks() for [('1876d1ce-e761-46f2-ab46-b61110e15c2c', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:12:07.768105 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:07.777528 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3a15e421-c498-4efc-9d05-899c24f4d337 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1367 microversion: 2.1 time: 0.401745 Sep 22 17:12:07.778374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 305/608] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:07 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:08.020128 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:08.020890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:08.029516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:08.030570 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:08.031513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:08.038957 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:08.038957 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:08.038957 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:08.182516 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:12:08.183409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:12:08.183868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:12:08.184455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:12:08.184881 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:12:08.195163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:08.196045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:08.196167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:08.196806 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:08.197261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:08.197685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:08.214353 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:08.215611 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Getting quotas for project 5fca6eabbca24bc09aee7e259ca82562. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:12:08.219932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Getting quotas for user c2060b33d0a24e01a96ab3fb02b4b045 and project 5fca6eabbca24bc09aee7e259ca82562. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:12:08.222897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:08.224393 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:08.226331 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cf639c2f-5fc8-4fd2-95d9-fb6bc6826fdf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1720 microversion: 2.20 time: 0.210257 Sep 22 17:12:08.226889 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 306/609] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:08 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:12:08.281274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:12:08.283525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='795f6a05-0aec-469a-afd4-632956ec2627',volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:12:08.418189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-15750958-87d9-4d80-9357-aaf0bf32ed49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.128422 Sep 22 17:12:08.419617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 304/610] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:12:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:12:08.430938 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-15aafc30-9476-4e33-b197-5e42c30cb85d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:08.431625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-15aafc30-9476-4e33-b197-5e42c30cb85d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:08.496230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-15aafc30-9476-4e33-b197-5e42c30cb85d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:08.503995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-15aafc30-9476-4e33-b197-5e42c30cb85d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1093 microversion: 2.1 time: 0.077542 Sep 22 17:12:08.504753 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 307/611] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:08 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:08.805003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:08.806208 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:08.812690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:08.813249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:08.813688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:08.814499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:08.815013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:08.815445 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:08.972958 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:08.982407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-90f74a89-179a-468d-ac8a-ff124b6bcf65 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1557 microversion: 2.1 time: 0.181881 Sep 22 17:12:08.983018 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 305/612] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:08 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1557 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:09.005615 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-12b90676-b7df-4d7a-8f51-9bf881a08ac5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:09.006175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-12b90676-b7df-4d7a-8f51-9bf881a08ac5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:09.014792 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b90676-b7df-4d7a-8f51-9bf881a08ac5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:09.015316 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b90676-b7df-4d7a-8f51-9bf881a08ac5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:09.015758 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b90676-b7df-4d7a-8f51-9bf881a08ac5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:09.016461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b90676-b7df-4d7a-8f51-9bf881a08ac5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:09.016911 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b90676-b7df-4d7a-8f51-9bf881a08ac5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:09.017336 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12b90676-b7df-4d7a-8f51-9bf881a08ac5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:09.101130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-12b90676-b7df-4d7a-8f51-9bf881a08ac5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099556 Sep 22 17:12:09.101724 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 308/613] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 22 17:12:09 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:12:09.253886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:09.254498 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:09.256939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:09.271818 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:09.272897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:09.273334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:09.274085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:09.274573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:09.275018 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:09.530514 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:09.531638 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:09.542205 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:09.543186 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:09.543904 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:09.545108 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:09.546159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:09.546715 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:09.547212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:09.559241 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:09.561489 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:09.569641 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6da21da1-1b6c-404a-a577-d406d4063ef5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1720 microversion: 2.20 time: 0.318105 Sep 22 17:12:09.570682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 306/614] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:09 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1720 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:09.626596 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:09.635693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a8930d70-aef3-4816-a06f-edf92b2b9172 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1143 microversion: 2.1 time: 0.111413 Sep 22 17:12:09.636295 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 309/615] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:09 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1143 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:10.475710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-2a7a602c-3fe2-4a53-b54a-1e1a6cf19534 req-8da663dd-2e89-413f-96da-a5e1d86415d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae76e1d7-dddd-4528-979a-025f671185aa", "tag": "a525dbad-0b77-49f5-92d5-87d346a4de53"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:10.485931 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-2a7a602c-3fe2-4a53-b54a-1e1a6cf19534 req-8da663dd-2e89-413f-96da-a5e1d86415d0 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:10.486480 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-2a7a602c-3fe2-4a53-b54a-1e1a6cf19534 req-8da663dd-2e89-413f-96da-a5e1d86415d0 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:10.487198 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-2a7a602c-3fe2-4a53-b54a-1e1a6cf19534 req-8da663dd-2e89-413f-96da-a5e1d86415d0 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:10.500378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-2a7a602c-3fe2-4a53-b54a-1e1a6cf19534 req-8da663dd-2e89-413f-96da-a5e1d86415d0 service nova] Creating event network-changed:a525dbad-0b77-49f5-92d5-87d346a4de53 for instance ae76e1d7-dddd-4528-979a-025f671185aa on hv-cinder-83538 Sep 22 17:12:10.505870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-2a7a602c-3fe2-4a53-b54a-1e1a6cf19534 req-8da663dd-2e89-413f-96da-a5e1d86415d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033804 Sep 22 17:12:10.507188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 307/616] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:12:10.606879 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:10.607535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:10.614261 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:10.614748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:10.615205 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:10.615948 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:10.616434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:10.616891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:10.660156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:10.660880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:10.667678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:10.668165 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:10.668599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:10.669357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:10.669904 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:10.670241 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:10.744112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:10.763369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-02776675-39a1-41fc-94b9-d879c1531763 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1143 microversion: 2.1 time: 0.102992 Sep 22 17:12:10.763369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 308/617] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:10 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1143 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:10.782343 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:10.790842 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:10.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:10.793643 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e019611c-de50-4636-9ec8-2ca804946a90 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1720 microversion: 2.20 time: 0.190695 Sep 22 17:12:10.794281 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 310/618] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:10 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:11.778021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-48b2213a-b1a8-4575-9397-97d3c0a97afd req-9965c84d-baf7-4755-b870-29aee526c051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2", "name": "network-vif-unplugged", "status": "completed", "tag": "9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:11.784245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:11.785915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:11.789060 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-48b2213a-b1a8-4575-9397-97d3c0a97afd req-9965c84d-baf7-4755-b870-29aee526c051 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:11.789535 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-48b2213a-b1a8-4575-9397-97d3c0a97afd req-9965c84d-baf7-4755-b870-29aee526c051 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:11.790518 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-48b2213a-b1a8-4575-9397-97d3c0a97afd req-9965c84d-baf7-4755-b870-29aee526c051 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:11.794201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:11.794874 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:11.795395 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:11.796097 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:11.796547 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:11.797114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:11.807107 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-48b2213a-b1a8-4575-9397-97d3c0a97afd req-9965c84d-baf7-4755-b870-29aee526c051 service nova] Creating event network-vif-unplugged:9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea for instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 on hv-cinder-83538 Sep 22 17:12:11.812419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-48b2213a-b1a8-4575-9397-97d3c0a97afd req-9965c84d-baf7-4755-b870-29aee526c051 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038460 Sep 22 17:12:11.813212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 309/619] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:12:11.821526 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:11.822232 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:11.829306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:11.829790 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:11.830225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:11.830921 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:11.831500 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:11.831820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:11.864034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:11.872981 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-618d3051-e370-4dba-9402-a189e4768561 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1143 microversion: 2.1 time: 0.092721 Sep 22 17:12:11.873688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 311/620] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:11 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:11.979305 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:11.988318 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:11.989919 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:11.991738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8440e032-4baa-4d6f-964b-9e27f187faaf tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1720 microversion: 2.20 time: 0.174943 Sep 22 17:12:11.992345 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 310/621] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:11 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:12:12.900951 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:12.901532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:12.908171 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:12.908654 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:12.909087 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:12.909783 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:12.910237 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:12.910661 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:12.970499 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:12.978177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-89964f60-1871-40aa-b1b7-185aa0b2633d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1143 microversion: 2.1 time: 0.081810 Sep 22 17:12:12.978745 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 312/622] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:12 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:13.017120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:13.017763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:13.024954 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:13.025484 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:13.025953 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:13.026653 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:13.027133 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:13.027577 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:13.215214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:13.223626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:13.225077 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:13.226239 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-463f0e69-d510-4172-b627-ef07c7e2b192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1720 microversion: 2.20 time: 0.213277 Sep 22 17:12:13.226799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 311/623] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:13 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:14.001862 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:14.002569 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:14.011904 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:14.012458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:14.013009 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:14.013850 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:14.014414 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:14.015841 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:14.082383 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:14.090331 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0234803a-a7d9-4319-a32f-696728fbbb66 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1191 microversion: 2.1 time: 0.092611 Sep 22 17:12:14.090982 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 313/624] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:13 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:14.252203 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:14.252830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:14.259252 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:14.259745 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:14.260187 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:14.260891 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:14.261347 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:14.261844 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:14.266543 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:14.399720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:14.408321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:14.409846 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:14.411159 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c1ac8e75-65e5-4be1-a287-1634f2f14779 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1720 microversion: 2.20 time: 0.163079 Sep 22 17:12:14.411719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 312/625] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:14 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:15.116817 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:15.117826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:15.125567 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:15.126056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:15.126487 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:15.127219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:15.127673 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:15.128100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:15.197980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:15.206029 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8be4f8fc-bb81-4b2f-a88a-bffede6b3027 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1191 microversion: 2.1 time: 0.096331 Sep 22 17:12:15.206601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 314/626] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:15 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:15.438594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:15.439213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:15.446249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:15.446721 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:15.447193 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:15.447878 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:15.448321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:15.448736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:15.583180 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:15.587916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:15.589355 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:15.590531 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2edfc347-1bfd-43fc-bf2f-5e2140dfb624 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1720 microversion: 2.20 time: 0.156095 Sep 22 17:12:15.591088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 313/627] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:15 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:16.229036 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:16.229644 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:16.236274 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:16.237235 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:16.237235 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:16.237862 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:16.238314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:16.238735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:16.304803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:16.312446 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-69bf4576-9826-461c-8ca8-c3fe3939232e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1191 microversion: 2.1 time: 0.087382 Sep 22 17:12:16.313006 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 315/628] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:16 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:16.615351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:16.615989 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:16.622543 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:16.623051 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:16.623485 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:16.624195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:16.624641 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:16.625061 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:16.901577 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:16.916895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:16.938433 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:16.941550 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-21a793ae-158b-4e9e-92ce-96c52b802919 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1723 microversion: 2.20 time: 0.330147 Sep 22 17:12:16.942143 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 314/629] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:16 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:16.970581 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e5d929da-7142-4dd8-88dd-4f3520436273 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "774e5840-372e-48f6-84fd-c3cf568ba427"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:16.973114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e5d929da-7142-4dd8-88dd-4f3520436273 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:16.979507 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5d929da-7142-4dd8-88dd-4f3520436273 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:16.983397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5d929da-7142-4dd8-88dd-4f3520436273 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:16.986399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5d929da-7142-4dd8-88dd-4f3520436273 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:16.987278 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5d929da-7142-4dd8-88dd-4f3520436273 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:16.988017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5d929da-7142-4dd8-88dd-4f3520436273 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:16.989434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5d929da-7142-4dd8-88dd-4f3520436273 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:17.068741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:17.305339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e5d929da-7142-4dd8-88dd-4f3520436273 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.339638 Sep 22 17:12:17.306405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 316/630] 10.222.0.16 () {62 vars in 1364 bytes} [Thu Sep 22 17:12:16 2022] POST /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments => generated 188 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:12:17.338157 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:17.338770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:17.346296 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:17.347008 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:17.347630 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:17.348561 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:17.349200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:17.350000 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:17.438482 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:17.447227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a0b4b32e-095f-4b60-92fb-ab2f2c5ebd60 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1209 microversion: 2.1 time: 0.113454 Sep 22 17:12:17.459400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 315/631] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:17 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1209 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:17.479317 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:17.479907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:17.486785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:17.487553 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:17.488049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:17.488761 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:17.489211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:17.489642 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:17.546189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120805) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 17:12:17.626274 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b047cb28-c5c0-446f-bbeb-88ce28ea9553 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/action" status: 202 len: 0 microversion: 2.20 time: 0.151422 Sep 22 17:12:17.627243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 317/632] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 22 17:12:17 2022] POST /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:12:17.636872 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:17.638116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:17.644983 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:17.645819 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:17.646256 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:17.647122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:17.647637 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:17.648062 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:17.804428 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:17.816644 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:17.818714 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:17.821290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ce853d74-7722-4d5d-b2a5-785be4e400e5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1749 microversion: 2.20 time: 0.189608 Sep 22 17:12:17.823141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 316/633] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:17 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1749 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:18.473478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:18.475701 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:18.482988 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:18.483654 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:18.484261 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:18.485256 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:18.485818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:18.486409 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:18.510711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:18.591002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-be3a6498-23f9-498c-a0a8-40eb47e73b01 req-12d5e2c6-79b0-49b2-aee0-f63b518a9bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6348b1f-b623-42cb-a0dc-a33cf088486a", "tag": "29509342-40b1-4e83-8923-eccd29758d12"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:18.597794 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:18.598797 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:18.610737 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-be3a6498-23f9-498c-a0a8-40eb47e73b01 req-12d5e2c6-79b0-49b2-aee0-f63b518a9bd8 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:18.611245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-be3a6498-23f9-498c-a0a8-40eb47e73b01 req-12d5e2c6-79b0-49b2-aee0-f63b518a9bd8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:18.611862 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-be3a6498-23f9-498c-a0a8-40eb47e73b01 req-12d5e2c6-79b0-49b2-aee0-f63b518a9bd8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:18.624100 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-be3a6498-23f9-498c-a0a8-40eb47e73b01 req-12d5e2c6-79b0-49b2-aee0-f63b518a9bd8 service nova] Creating event network-changed:29509342-40b1-4e83-8923-eccd29758d12 for instance b6348b1f-b623-42cb-a0dc-a33cf088486a on hv-cinder-83538 Sep 22 17:12:18.629472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-be3a6498-23f9-498c-a0a8-40eb47e73b01 req-12d5e2c6-79b0-49b2-aee0-f63b518a9bd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042189 Sep 22 17:12:18.630568 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 317/634] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:12:18.658348 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:18.666847 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-136aaef2-402c-4762-a628-3344d96391a3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.199748 Sep 22 17:12:18.667752 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 318/635] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:18 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:18.851204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:18.851626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:18.857661 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:18.858149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:18.858579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:18.859293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:18.859738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:18.860153 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:19.014453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:19.024238 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:19.025821 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:19.027250 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-37d4d505-fef8-457d-9374-97f9ce1754bc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1749 microversion: 2.20 time: 0.181180 Sep 22 17:12:19.027964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 318/636] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:18 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:19.690648 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:19.691329 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:19.697856 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:19.698330 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:19.698757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:19.699472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:19.699920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:19.700339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:19.832142 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:19.840710 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-016b5eb2-c9a3-4819-b6bc-0bc671926d43 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.153984 Sep 22 17:12:19.841277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 319/637] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:19 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:20.055055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:20.055664 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:20.062110 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:20.062619 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:20.063099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:20.063788 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:20.064237 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:20.064658 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:20.200308 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:20.208939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:20.210423 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:20.211639 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-112337b8-7a27-44ef-afb9-c779dda0a640 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1751 microversion: 2.20 time: 0.161076 Sep 22 17:12:20.212194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 319/638] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:20 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:20.863861 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:20.864643 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:20.871208 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:20.871694 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:20.872129 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:20.872831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:20.873358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:20.873801 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:21.029019 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:21.037748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d54a14b6-be87-4a5f-aaf4-4f1494007946 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.177556 Sep 22 17:12:21.038309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 320/639] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:20 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:21.236727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:21.237429 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:21.244950 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:21.245457 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:21.245889 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:21.246578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:21.247049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:21.247466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:21.380041 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:21.388719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:21.390037 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:21.391216 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8d4847d9-4a13-430a-afd8-83c64d57f7ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.158360 Sep 22 17:12:21.391765 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 320/640] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:21 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:22.061808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:22.062322 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:22.069532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:22.070174 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:22.070611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:22.071375 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:22.071834 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:22.072255 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:22.207952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:22.215747 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-da144985-4dac-4ded-b555-8c1a56ce036c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.157899 Sep 22 17:12:22.216324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 321/641] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:22 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:22.417966 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:22.418579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:22.425731 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:22.426217 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:22.426649 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:22.427378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:22.428563 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:22.429001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:22.564246 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:22.573456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:22.574920 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:22.576092 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-88d674ef-737b-46fc-a53f-43add7dba3ca tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.162573 Sep 22 17:12:22.576647 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 321/642] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:22 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:23.239255 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:23.239868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:23.242471 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:23.248381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:23.248881 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:23.249460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:23.250170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:23.250620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:23.251082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:23.395254 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:23.404439 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3f10d733-e605-46e9-bd47-97f73f49edb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.169208 Sep 22 17:12:23.405383 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 322/643] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:23 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:23.602052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:23.602663 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:23.609441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:23.609929 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:23.610468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:23.611229 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:23.611796 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:23.612228 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:23.748689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:23.758839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:23.760315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:23.761494 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4216f20b-d4cd-4c96-8a16-73641fdcfa1e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.163583 Sep 22 17:12:23.762051 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 322/644] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:23 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:24.428818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:24.431309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:24.451102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:24.453873 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:24.455614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:24.456613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:24.457918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:24.460121 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:24.621222 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:24.629400 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-984b7d6c-3624-43ce-8529-c3219b335432 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.205524 Sep 22 17:12:24.629973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 323/645] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:24 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:24.788209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:24.788990 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:24.795939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:24.796485 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:24.796943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:24.797639 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:24.798083 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:24.798557 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:24.970453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:24.979662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:24.981097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:24.982253 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fadf1771-d9ff-4376-8fea-7e047d349e5e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.198612 Sep 22 17:12:24.982806 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 323/646] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:24 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:25.653488 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:25.654109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:25.666991 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:25.667558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:25.668178 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:25.668878 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:25.669414 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:25.669770 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:25.850077 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:25.861956 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-db460cf3-fc4f-47aa-889c-0794f425fac0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.212351 Sep 22 17:12:25.862820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 324/647] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:25 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:26.009279 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:26.009880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:26.027871 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:26.048125 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:26.049304 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:26.051075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:26.052145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:26.053051 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:26.337419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:26.356178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:26.357738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:26.359066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-88482dd8-a814-425a-9912-b8d10ce07c89 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.353602 Sep 22 17:12:26.359557 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 324/648] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:26 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:26.885836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:26.886416 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:26.901145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:26.901975 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:26.902634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:26.903761 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:26.904428 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:26.905279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:27.079672 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:27.102652 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-28478f5a-358f-4646-9cc3-117ab756af00 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.220725 Sep 22 17:12:27.103831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 325/649] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:26 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:27.387400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:27.388166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:27.394802 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:27.395445 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:27.397856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:27.398831 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:27.399527 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:27.400165 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:27.609412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:27.627696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:27.630465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:27.632943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a2be68f1-9472-4e22-b9ca-d31bd7fa1178 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.249828 Sep 22 17:12:27.645864 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 325/650] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:27 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:28.126685 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:28.127339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:28.135092 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:28.135589 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:28.136029 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:28.136725 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:28.137173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:28.137591 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:28.316727 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:28.325922 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-db989fb6-7fa5-4dc7-bc72-729d9ff35f07 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.203211 Sep 22 17:12:28.326503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 326/651] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:28 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:28.659665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:28.660929 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:28.669379 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:28.670148 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:28.670562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:28.671316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:28.671918 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:28.672487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:28.909680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:28.920712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:28.922699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:28.924237 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4ed131d4-379c-4cd2-a0a6-898e8fcdba75 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.268995 Sep 22 17:12:28.926123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 326/652] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:28 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:29.353305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:29.354610 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:29.365165 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:29.372418 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:29.373133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:29.374166 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:29.374485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:29.374903 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:29.951031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:29.976998 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-758975e4-b7e3-4a8f-8af4-8db0803f5b33 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.627218 Sep 22 17:12:29.980475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 327/653] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:29 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:30.401985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:30.402673 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:30.413957 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:30.414366 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:30.414803 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:30.415619 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:30.416056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:30.416480 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:30.746737 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:30.759137 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:30.761062 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:30.764338 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9163bb63-4e9b-49e6-835f-4ff55a66b2eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.815649 Sep 22 17:12:30.765634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 327/654] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:29 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:12:31.006222 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:31.006974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:31.020238 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:31.024065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:31.024755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:31.028999 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:31.029657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:31.030177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:31.282514 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:31.292102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b9509cff-a87a-426b-a69d-caedbfb303a0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.292621 Sep 22 17:12:31.308850 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 328/655] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:30 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:31.791746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:31.792417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:31.800193 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:31.800782 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:31.801328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:31.802148 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:31.802835 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:31.803542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:32.061887 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:32.082151 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:32.085740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:32.088581 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7e3bd6a5-2e42-4a27-b2e8-52068eb2c607 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.301016 Sep 22 17:12:32.089471 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 328/656] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:31 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:12:32.316726 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:32.317332 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:32.344459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:32.344958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:32.356024 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:32.358433 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:32.359013 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:32.359833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:32.676408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:32.684172 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:32.688789 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6d3d6d26-0cf0-4b74-a226-3d12e6154fb9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.376057 Sep 22 17:12:32.690468 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 329/657] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:32 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:33.115866 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:33.116569 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:33.129879 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:33.130916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:33.131373 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:33.132286 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:33.132739 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:33.133163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:33.157875 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:33.387491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:33.436084 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:33.439523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:33.442655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8d2d9173-b44f-4c3c-9766-4f07e93724b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.332179 Sep 22 17:12:33.445520 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 329/658] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:33 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:12:33.727424 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:33.728766 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:33.737111 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:33.737979 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:33.738877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:33.739920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:33.741090 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:33.741723 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:34.035957 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:34.049863 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-45e5f002-fd83-42ec-b437-32ccaee36906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.327451 Sep 22 17:12:34.050443 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 330/659] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:33 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:34.494245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:34.495706 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:34.508083 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:34.508875 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:34.509472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:34.510333 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:34.510988 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:34.511563 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:34.858631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:34.869264 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:34.871816 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:34.873439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-afce6c63-4278-44b6-beb4-624c058a1d1d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.383835 Sep 22 17:12:34.887880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 330/660] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:34 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:35.085181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:35.087570 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:35.106021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:35.106574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:35.107048 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:35.107771 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:35.108225 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:35.108645 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:35.497198 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:35.512564 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9a0d07aa-5968-45ce-a017-d901ed3f7cf3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.437995 Sep 22 17:12:35.513310 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 331/661] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:35 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:35.902416 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:35.904009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:35.913140 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:35.914099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:35.914550 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:35.915439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:35.915973 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:35.916601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:36.470884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:36.490125 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:36.493513 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:36.499552 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4cadf2a3-e403-4da6-97c9-09d4958293df tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.600070 Sep 22 17:12:36.503351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 331/662] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:35 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:36.538210 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:36.539933 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:36.564898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:36.565386 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:36.565925 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:36.567808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:36.568282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:36.568888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:36.859727 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:36.869213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-12af017e-c808-4cbb-a962-af5fc3719f48 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.336355 Sep 22 17:12:36.870393 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 332/663] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:36 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:37.530674 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:37.531495 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:37.545372 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:37.546141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:37.546687 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:37.547338 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:37.551432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:37.552574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:37.719568 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:37.729426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:37.730909 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:37.732369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-484ae77a-6c85-4c1b-8b89-30c1168bd8ed tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.207312 Sep 22 17:12:37.751988 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 332/664] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:37 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:37.895896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:37.897761 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:37.908666 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:37.909497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:37.910215 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:37.911232 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:37.911933 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:37.912584 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:38.129218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:38.139007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-81666db4-34e6-4964-abc8-efc83781c691 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.249670 Sep 22 17:12:38.148732 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 333/665] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:37 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:38.760429 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:38.761851 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:38.768691 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:38.769200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:38.769645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:38.770544 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:38.771705 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:38.772136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:38.945405 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:38.961834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:38.965170 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:38.971622 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9d471444-b018-4543-a17d-b2d0859a0eae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.211383 Sep 22 17:12:38.974709 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 333/666] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:38 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:39.168254 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:39.172290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:39.186746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:39.187326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:39.187746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:39.188470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:39.188925 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:39.189350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:39.379222 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:39.391742 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a7dd9ccc-01bc-4aea-87ff-620dba9e3060 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.233352 Sep 22 17:12:39.392256 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 334/667] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:39 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:40.011821 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:40.013073 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:40.024492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=56 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:40.027114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:40.027942 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:40.028605 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:40.029899 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:40.030616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:40.031322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:40.405264 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:40.417459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:40.418709 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:40.422734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:40.424718 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:40.425923 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5ef098b1-0f56-4c6c-a00a-2a47decbf05c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.424174 Sep 22 17:12:40.432527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:40.433023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:40.433458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:40.434168 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:40.434783 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:40.435372 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:40.439505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 334/668] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:40 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:40.649889 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:40.662902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f2ff3798-d17d-4659-8c2d-93ab093d6ad1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.249298 Sep 22 17:12:40.663898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 335/669] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:40 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:41.457321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:41.460000 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:41.466662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:41.467531 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:41.468200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:41.469002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:41.469654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:41.470146 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:41.659866 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:41.671923 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:41.673360 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:41.674847 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-103f45a5-d56a-4977-a7ab-300d67e55663 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.222328 Sep 22 17:12:41.675786 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 335/670] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:41 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:41.691873 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:41.693895 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:41.702520 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:41.703278 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:41.703781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:41.704814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:41.705473 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:41.706122 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:41.888757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:41.897911 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-188d1466-1f58-427e-915b-537b850430e4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.210566 Sep 22 17:12:41.898776 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 336/671] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:41 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:42.714288 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:42.716076 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:42.730579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:42.731414 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:42.732027 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:42.732916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:42.733534 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:42.734136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:42.921766 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:42.922375 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:42.934234 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:42.938503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:42.939241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:42.940178 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:42.940640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:42.941069 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:42.994841 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:43.010677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:43.014780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:43.024568 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9e660bc7-bd9e-4d4d-8658-5a9c157ff1f3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.314104 Sep 22 17:12:43.025413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 336/672] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:42 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:43.179877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:43.205564 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-15160ab3-3f5e-4c5f-bb45-7b47490332dc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.287481 Sep 22 17:12:43.206771 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 337/673] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:42 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:44.051748 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:44.053655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:44.065316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:44.065814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:44.066260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:44.071992 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:44.072465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:44.073153 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:44.236830 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:44.237746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:44.247623 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:44.248313 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:44.249033 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:44.250075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:44.250804 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:44.251326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:44.374167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:44.386497 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:44.388097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:44.389328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-be57c6c9-f981-407a-9e18-e22cc4fda4de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.342036 Sep 22 17:12:44.389906 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 337/674] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:44 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:44.439734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:44.448398 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bcd2d337-0e64-4c38-9fb3-535df54d204c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.215697 Sep 22 17:12:44.454793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 338/675] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:44 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:44.647373 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-8ab65058-8db6-44eb-858f-59b1071b2fc5 req-8620343c-5ce1-4103-8cf5-7591f6754c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6348b1f-b623-42cb-a0dc-a33cf088486a", "name": "network-vif-plugged", "status": "completed", "tag": "29509342-40b1-4e83-8923-eccd29758d12"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:44.677542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-8ab65058-8db6-44eb-858f-59b1071b2fc5 req-8620343c-5ce1-4103-8cf5-7591f6754c73 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:44.678426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-8ab65058-8db6-44eb-858f-59b1071b2fc5 req-8620343c-5ce1-4103-8cf5-7591f6754c73 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:44.679158 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-8ab65058-8db6-44eb-858f-59b1071b2fc5 req-8620343c-5ce1-4103-8cf5-7591f6754c73 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:44.702439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-8ab65058-8db6-44eb-858f-59b1071b2fc5 req-8620343c-5ce1-4103-8cf5-7591f6754c73 service nova] Creating event network-vif-plugged:29509342-40b1-4e83-8923-eccd29758d12 for instance b6348b1f-b623-42cb-a0dc-a33cf088486a on hv-cinder-83538 Sep 22 17:12:44.712330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-8ab65058-8db6-44eb-858f-59b1071b2fc5 req-8620343c-5ce1-4103-8cf5-7591f6754c73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074295 Sep 22 17:12:44.713699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 338/676] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:12:45.424093 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:45.425441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:45.433540 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:45.434011 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:45.434687 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:45.436449 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:45.437141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:45.437759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:45.491236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:45.491895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:45.498976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:45.499943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:45.501057 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:45.502139 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:45.502626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:45.503799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:45.703936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:45.719154 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:45.726201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:45.732468 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6f11f1fa-d84f-4f83-a18c-05a9f48cb655 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.307626 Sep 22 17:12:45.743339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 339/677] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:45 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:45.776939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:45.785585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-552ac07c-b73f-45a5-a8eb-f0c92a8c9eb0 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.309252 Sep 22 17:12:45.786206 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 339/678] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:45 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:46.765613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:46.766885 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:46.775105 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:46.775997 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:46.776483 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:46.777501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:46.778186 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:46.778825 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:46.814191 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:46.815107 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:46.836797 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:46.838341 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:46.839573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:46.848023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:46.848915 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:46.849969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:47.031676 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:47.042017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:47.043824 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:47.045441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-77dbb9dc-4704-4b9b-9d12-cf3558f17f63 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.284081 Sep 22 17:12:47.046363 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 340/679] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:46 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:47.079372 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:47.089328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-89c3b19b-a45a-4261-9ece-5730ea8c6d92 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.279336 Sep 22 17:12:47.090217 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 340/680] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:46 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:48.077012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:48.078205 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:48.085683 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:48.086428 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:48.087152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:48.088195 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:48.088942 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:48.089420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:48.112688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:48.113351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:48.120774 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:48.121533 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:48.122227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:48.123140 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:48.123809 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:48.124384 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:48.303969 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:48.314072 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:48.316213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:48.317991 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fe759fbe-723d-4c71-8d33-28c98eecf144 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.244439 Sep 22 17:12:48.318588 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 341/681] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:48 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:48.355459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:48.367162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cb92430c-bd12-4588-9d8e-138876728124 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1264 microversion: 2.1 time: 0.258481 Sep 22 17:12:48.367770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 341/682] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:48 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:49.109581 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6bc56e65-e7d8-4b91-a058-679fd5d1e73a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Action: 'create', calling method: .version_select at 0x7f51d926f4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-33544653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeFMcB5lmoPSbABcAeknhTI5Dwe/X9w7qaWbSseZLs0WcSvvskloGHrq18G3PoQlCC6oiPU8yqgT3QvaLlNO/bcV3Cmrj1BwEEfKUfgbISwjKk3H1YQ1tYmR7+X2dLKNA=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:49.125923 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-6bc56e65-e7d8-4b91-a058-679fd5d1e73a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Getting quotas for project 0749b2616b854791aec389d669ef94c8. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:12:49.130462 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-6bc56e65-e7d8-4b91-a058-679fd5d1e73a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Getting quotas for user cf878d3df653463caa7767de835dce83 and project 0749b2616b854791aec389d669ef94c8. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:12:49.152531 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6bc56e65-e7d8-4b91-a058-679fd5d1e73a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.046783 Sep 22 17:12:49.153125 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 342/683] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:12:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:12:49.206321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1405351834", "imageRef": "e78726fa-484b-4fcd-aa03-81b4325df737", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-33544653", "networks": [{"uuid": "4b09edd4-a749-403e-9dd8-93689c623cd0"}]}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:49.260470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] validate_networks() for [('4b09edd4-a749-403e-9dd8-93689c623cd0', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:12:49.345531 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:49.346406 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:49.353339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:49.353825 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:49.354248 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:49.354939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:49.355640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:49.356325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:49.535438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:49.544094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:49.545656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:49.546864 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-885d64fb-6bbc-4b14-9917-fcd59c8b5a51 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.206620 Sep 22 17:12:49.547453 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 343/684] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:49 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:12:49.556777 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:49.557525 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:49.563529 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:49.564478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:49.564478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:49.565114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:49.565561 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:49.565981 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:49.786707 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:49.795099 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e7ca000a-be4d-4054-b73b-c752ab8b9011 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1451 microversion: 2.1 time: 0.245887 Sep 22 17:12:49.795696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 344/685] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:49 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1451 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:49.809874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:12:49.810300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:12:49.810774 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:12:49.811214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:12:49.811632 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:12:49.820316 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:49.820928 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:49.822229 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:49.822824 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:49.823413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:49.824208 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:49.824769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:49.825257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:49.827139 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:49.827630 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:49.828062 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:49.828757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:49.829204 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:49.829793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:49.843789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Getting quotas for project 0749b2616b854791aec389d669ef94c8. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:12:49.847882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Getting quotas for user cf878d3df653463caa7767de835dce83 and project 0749b2616b854791aec389d669ef94c8. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:12:49.858967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:12:49.861204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e78726fa-484b-4fcd-aa03-81b4325df737',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:12:49.907890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-01de3cb2-33ee-431d-b709-4796c526611b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705357 Sep 22 17:12:49.908717 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 342/686] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:12:49.919579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-494e93c6-18fe-4d7c-87ee-6884f1865c67 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:49.920124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-494e93c6-18fe-4d7c-87ee-6884f1865c67 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:49.989636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-494e93c6-18fe-4d7c-87ee-6884f1865c67 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:49.996859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-494e93c6-18fe-4d7c-87ee-6884f1865c67 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1257 microversion: 2.1 time: 0.080986 Sep 22 17:12:49.997756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 343/687] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:49 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:50.014201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:50.022212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-53e4a176-ce85-460b-bec3-590997630265 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1451 microversion: 2.1 time: 0.206236 Sep 22 17:12:50.022830 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 345/688] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:49 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1451 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:50.573343 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:50.573960 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:50.584201 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:50.585071 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:50.585680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:50.586578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:50.587590 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:50.588172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:50.749454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:50.761438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:50.763021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:50.764249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e22bcac0-c2de-4022-8587-56c1813d9d69 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.195462 Sep 22 17:12:50.764995 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 344/689] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:50 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:51.020317 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:51.021516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:51.035408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:51.035985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:51.036425 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:51.037148 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:51.037600 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:51.038022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:51.108756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:51.122974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a6623c00-3c05-4b4f-89d2-ddc23c7c9d4d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1309 microversion: 2.1 time: 0.105792 Sep 22 17:12:51.122974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 346/690] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:51 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:51.795177 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:51.795874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:51.803385 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:51.803868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:51.804299 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:51.805001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:51.805512 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:51.805932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:51.972503 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:51.982410 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:51.984129 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:51.985331 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b51412d3-6704-4cbe-a58a-71247fa08210 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.195877 Sep 22 17:12:51.989058 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 345/691] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:51 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:52.147031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:52.147752 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:52.161400 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:52.163684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:52.164503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:52.165993 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:52.167045 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:52.168093 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:52.226491 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:52.326782 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:52.343286 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f2627cbd-2afb-472d-8dd2-236b43db3a7d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1315 microversion: 2.1 time: 0.200650 Sep 22 17:12:52.345764 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 347/692] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:52 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:52.829771 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-4118bc10-3e71-44bb-84ad-06b96bffd47e req-120974df-e1aa-4609-b713-6e182e935e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2", "name": "network-vif-plugged", "status": "completed", "tag": "9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:52.887249 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-4118bc10-3e71-44bb-84ad-06b96bffd47e req-120974df-e1aa-4609-b713-6e182e935e15 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:52.887742 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-4118bc10-3e71-44bb-84ad-06b96bffd47e req-120974df-e1aa-4609-b713-6e182e935e15 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:52.890900 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-4118bc10-3e71-44bb-84ad-06b96bffd47e req-120974df-e1aa-4609-b713-6e182e935e15 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:52.932274 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-4118bc10-3e71-44bb-84ad-06b96bffd47e req-120974df-e1aa-4609-b713-6e182e935e15 service nova] Creating event network-vif-plugged:9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea for instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 on hv-cinder-83538 Sep 22 17:12:52.945632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-4118bc10-3e71-44bb-84ad-06b96bffd47e req-120974df-e1aa-4609-b713-6e182e935e15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125399 Sep 22 17:12:52.949753 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 348/693] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:12:53.011194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-19ddc8ea-7941-4a8c-bd16-2f619417f59a req-197cf431-836e-48cb-98fc-90452d14e523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6348b1f-b623-42cb-a0dc-a33cf088486a", "tag": "29509342-40b1-4e83-8923-eccd29758d12"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:12:53.013606 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:53.014587 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:53.022523 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:53.023392 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:53.024029 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:53.025036 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:53.029270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:53.030160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:53.039884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-19ddc8ea-7941-4a8c-bd16-2f619417f59a req-197cf431-836e-48cb-98fc-90452d14e523 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:53.040385 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-19ddc8ea-7941-4a8c-bd16-2f619417f59a req-197cf431-836e-48cb-98fc-90452d14e523 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:53.043030 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-19ddc8ea-7941-4a8c-bd16-2f619417f59a req-197cf431-836e-48cb-98fc-90452d14e523 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:53.068013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-19ddc8ea-7941-4a8c-bd16-2f619417f59a req-197cf431-836e-48cb-98fc-90452d14e523 service nova] Creating event network-changed:29509342-40b1-4e83-8923-eccd29758d12 for instance b6348b1f-b623-42cb-a0dc-a33cf088486a on hv-cinder-83538 Sep 22 17:12:53.092488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-19ddc8ea-7941-4a8c-bd16-2f619417f59a req-197cf431-836e-48cb-98fc-90452d14e523 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.280242 Sep 22 17:12:53.093180 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 346/694] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:12:53.316399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:53.331619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:53.334460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:53.335923 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-424ecb0e-f8ba-405b-b102-092ba4cb7fb1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.327557 Sep 22 17:12:53.336504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 349/695] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:53 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:12:53.371392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:53.372454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:53.382518 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:53.383050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:53.383492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:53.384214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:53.384667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:53.385111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:53.565406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:53.576642 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-65eb53e7-dd05-4ba7-8c8d-4f2613945338 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.210216 Sep 22 17:12:53.577237 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 347/696] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:53 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:54.390362 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:54.391450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:54.417793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:54.421374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:54.422400 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:54.427401 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:54.428836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:54.435433 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:54.436415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:54.608804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:54.609955 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:54.634631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:54.637873 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:54.638893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:54.640849 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:54.644163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:54.645147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:54.783282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:54.805123 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:54.808487 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:54.811322 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3bdfc2ce-93b2-491c-ab86-b44e1d56abc1 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.438393 Sep 22 17:12:54.812380 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 350/697] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:54 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:54.893643 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:54.910934 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c196e1c0-b476-42ad-a4d5-7558380552bf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.311769 Sep 22 17:12:54.912656 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 348/698] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:54 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:55.838883 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:55.840223 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:55.847243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:55.847735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:55.848842 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:55.849598 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:55.850234 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:55.850785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:55.946211 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:55.955215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:55.969375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:55.970552 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:55.971621 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:55.973185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:55.975111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:55.976208 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:55.984900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:56.020787 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:56.031686 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:56.033144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:56.034332 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3e7f784d-89af-48bb-b742-afe43a186c92 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.199592 Sep 22 17:12:56.040334 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 351/699] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:55 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:56.184895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:56.194104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a6fbd3ba-4ade-45f7-81cb-03a05dbb947b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.255855 Sep 22 17:12:56.194704 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 349/700] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:55 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:12:57.061810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:57.062472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:57.069896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:57.070785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:57.071484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:57.072461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:57.073159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:57.073809 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:57.217771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:57.218498 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:57.226689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:57.227240 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:57.227701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:57.228773 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:57.229932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:57.230573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:57.240473 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:57.262259 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:57.265792 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:57.268230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3326be33-dbf6-49bb-97a2-c1e31ecb574a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.210492 Sep 22 17:12:57.268887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 352/701] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:57 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:12:57.409481 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:57.417640 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-184d5fd7-8579-43a0-b5cb-3f46818a2588 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.203817 Sep 22 17:12:57.418214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 350/702] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:57 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:58.293762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:58.294372 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:58.301475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:58.302012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:58.302451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:58.303195 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:58.303649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:58.304070 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:58.441551 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:58.442772 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:58.449415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:58.449907 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:58.450346 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:58.451076 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:58.451536 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:58.452011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:58.459617 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:58.477989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:58.479645 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:58.480821 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-41ce88ef-7f75-4b91-b8a0-9f58bd7c2195 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.191008 Sep 22 17:12:58.481392 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 353/703] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:58 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:58.614273 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:58.622095 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f6b8223b-26d5-402b-8aa7-b0fc3174b1f2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.184438 Sep 22 17:12:58.622658 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 351/704] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:58 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:12:59.515627 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:59.516290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:59.518141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=4 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:12:59.524391 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:59.524872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:59.525300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:59.525993 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:59.526439 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:59.526858 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:59.645433 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:12:59.646065 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:12:59.652946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:59.653532 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:59.654117 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:59.654841 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:12:59.655583 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:12:59.656074 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:12:59.671561 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:59.691185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:59.695277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:59.697147 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ee9d311a-96ea-415c-9858-69aa33e240d5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.185309 Sep 22 17:12:59.698204 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 354/705] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:12:59 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:12:59.819999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:12:59.834138 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0a12d056-b6a0-45f8-9c35-2369d9032645 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.192282 Sep 22 17:12:59.835161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 352/706] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:12:59 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:00.724207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:00.724765 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:00.731362 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:00.731866 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:00.732299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:00.732994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:00.733441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:00.733857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:00.857865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:00.858472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:00.860415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:00.861121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=8 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:00.867343 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:00.867842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:00.868282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:00.869012 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:00.869471 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:00.869904 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:00.871755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:00.881409 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:00.883084 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:00.884280 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fd4fc883-c431-43aa-9a27-76e9a6063384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.164470 Sep 22 17:13:00.884853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 355/707] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:00 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:01.005749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:01.013564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cfae181b-c639-43f5-8395-f3b6419a8cb5 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.159612 Sep 22 17:13:01.014135 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 353/708] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:00 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:01.911370 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:01.912649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:01.919694 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:01.920471 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:01.921118 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:01.922021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:01.922662 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:01.923307 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:02.038734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:02.039334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:02.045770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:02.046463 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:02.046682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:02.047421 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:02.047872 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:02.048299 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:02.063638 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:02.076377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:02.077832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:02.079190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-94d81167-df54-431c-aba5-2d5cc5d27df4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.172631 Sep 22 17:13:02.079872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 356/709] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:01 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:02.203938 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:02.218760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4e2090dc-e18d-4b32-a1e0-53dbd7619be9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.179570 Sep 22 17:13:02.218760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 354/710] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:02 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:03.106168 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:03.106730 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:03.114074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:03.114584 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:03.115049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:03.115739 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:03.116193 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:03.116616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:03.242038 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:03.242656 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:03.249565 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:03.250059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:03.250493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:03.251231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:03.251685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:03.252108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:03.258901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:03.274104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:03.276934 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:03.278999 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2ca7bed2-2d2b-4f96-8d96-c406fe385256 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.177112 Sep 22 17:13:03.280127 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 357/711] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:03 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:03.396706 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:03.404449 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-33e42e2c-3741-4eae-8f86-4add06963ebf tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.166338 Sep 22 17:13:03.405005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 355/712] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:03 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:04.305140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:04.305701 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:04.312495 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:04.312988 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:04.313420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:04.314123 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:04.314579 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:04.315037 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:04.427596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:04.428213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:04.434725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:04.435249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:04.435688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:04.436405 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:04.436863 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:04.437286 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:04.450505 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:04.459491 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:04.460915 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:04.462084 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ca3be300-4014-40d8-88eb-d7941e2aae88 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.161240 Sep 22 17:13:04.462655 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 358/713] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:04 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:04.573005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:04.580612 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1638ec93-9326-4101-b8ab-c1031af9a540 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.157738 Sep 22 17:13:04.581173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 356/714] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:04 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:05.488023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:05.488680 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:05.495498 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:05.495966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:05.496397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:05.497099 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:05.497549 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:05.498002 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:05.603427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:05.604149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:05.611689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:05.612224 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:05.612674 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:05.613901 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:05.614352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:05.614783 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:05.643085 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:05.652573 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:05.654067 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:05.655358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-79316388-500a-491d-9041-d949721c457a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.171224 Sep 22 17:13:05.655935 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 359/715] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:05 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:05.752693 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:05.764710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ebedf612-2760-4dbd-80a2-090b68875356 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.165132 Sep 22 17:13:05.765611 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 357/716] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:05 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:06.681369 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:06.681978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:06.688803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:06.689280 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:06.689708 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:06.690391 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:06.690843 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:06.691285 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:06.788826 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:06.789445 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:06.796072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:06.796555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:06.797049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:06.797752 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:06.798201 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:06.798865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:06.830324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:06.839750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:06.841212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:06.842364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-57c5a251-3fbd-4b1c-9a30-4bdfae64606f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.165579 Sep 22 17:13:06.843138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 360/717] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:06 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:06.937771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:06.945468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5daf92d6-bf0d-4667-a0aa-ef297e53db37 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.161530 Sep 22 17:13:06.946050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 358/718] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:06 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:07.657764 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-731303bf-3155-4eb4-bbdf-f5355d2dca91 req-a1a0309d-ce56-4c69-9e14-03db47a3ce83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b", "tag": "5886ff66-8e7f-4da4-960b-035ee76660f1"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:07.670118 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-731303bf-3155-4eb4-bbdf-f5355d2dca91 req-a1a0309d-ce56-4c69-9e14-03db47a3ce83 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:07.670656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-731303bf-3155-4eb4-bbdf-f5355d2dca91 req-a1a0309d-ce56-4c69-9e14-03db47a3ce83 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:07.671177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-731303bf-3155-4eb4-bbdf-f5355d2dca91 req-a1a0309d-ce56-4c69-9e14-03db47a3ce83 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:07.685346 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-731303bf-3155-4eb4-bbdf-f5355d2dca91 req-a1a0309d-ce56-4c69-9e14-03db47a3ce83 service nova] Creating event network-changed:5886ff66-8e7f-4da4-960b-035ee76660f1 for instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b on hv-cinder-83538 Sep 22 17:13:07.691194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-731303bf-3155-4eb4-bbdf-f5355d2dca91 req-a1a0309d-ce56-4c69-9e14-03db47a3ce83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037801 Sep 22 17:13:07.692180 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 361/719] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:13:07.868634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:07.869611 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:07.875939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:07.876426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:07.876863 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:07.877573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:07.878021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:07.878446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:07.969010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:07.969741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:07.976823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:07.977304 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:07.977736 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:07.978441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:07.978996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:07.979463 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:08.028778 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:08.045588 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:08.047075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:08.048280 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ff4b86ca-acaf-486c-bdf8-c6087e757f6c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.184921 Sep 22 17:13:08.049126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 359/720] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:07 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:08.132059 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:08.140352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4e2df3fd-275b-49e2-a623-04aedd2bc0a2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.175722 Sep 22 17:13:08.140946 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 362/721] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:07 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:09.078803 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:09.079592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:09.087791 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:09.088276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:09.088708 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:09.089416 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:09.089867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:09.090288 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:09.164006 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:09.164667 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:09.172213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:09.172788 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:09.173329 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:09.174374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:09.174852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:09.175315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:09.706173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:09.716794 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:09.718510 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:09.720198 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:09.721412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-38e1f471-ef43-45fe-a929-f9dca4b9d6d9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.647005 Sep 22 17:13:09.722322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 360/722] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:09 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:09.724989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-368e6bc0-7964-43e9-ae6d-8636e26c1434 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.565521 Sep 22 17:13:09.725996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 363/723] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:09 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:10.748766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:10.749361 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:10.749732 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:10.749834 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:10.751790 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:10.757301 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:10.757492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:10.757844 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:10.758137 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:10.758673 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:10.759216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:10.759427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:10.759886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:10.760074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:10.760316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:10.760558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:10.761019 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:10.964712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:10.969091 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:10.972888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2f1b6837-4917-4775-9372-3dfc431e0606 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.228115 Sep 22 17:13:10.973482 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 364/724] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:10 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:10.980425 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:10.980425 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:10.980891 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f740a837-5e52-43a8-9b56-c17c814c2689 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.236190 Sep 22 17:13:10.981409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 361/725] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:10 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:11.996785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:11.996785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:12.003800 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:12.004296 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:12.004727 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:12.005943 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:12.006394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:12.006734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:12.007216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:12.007403 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:12.014760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:12.015298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:12.015733 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:12.016500 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:12.016894 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:12.017324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:12.027626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:12.212807 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:12.215763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:12.220967 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cc8db2e7-6c36-47c3-be30-aa49cff52fb1 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.228604 Sep 22 17:13:12.221553 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 365/726] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:11 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:12.224843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:12.226277 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:12.227466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4cb89e1e-b3ac-4c8b-9a0b-6ec84b3d7462 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.225148 Sep 22 17:13:12.228009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 362/727] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:12 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:13:13.061503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b14da0d1-502a-47ba-9fb7-b8f87c9b8258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1baa4f1-89d9-49f5-a443-2f0f6e979ce2"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:13.064319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b14da0d1-502a-47ba-9fb7-b8f87c9b8258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:13.070504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b14da0d1-502a-47ba-9fb7-b8f87c9b8258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:13.071041 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b14da0d1-502a-47ba-9fb7-b8f87c9b8258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:13.071478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b14da0d1-502a-47ba-9fb7-b8f87c9b8258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:13.072175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b14da0d1-502a-47ba-9fb7-b8f87c9b8258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:13.072685 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b14da0d1-502a-47ba-9fb7-b8f87c9b8258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:13.073107 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b14da0d1-502a-47ba-9fb7-b8f87c9b8258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:13.244412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:13.245024 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:13.251761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:13.257067 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:13.257538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:13.258265 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:13.258724 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:13.259199 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:13.413598 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:13.423472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c2af293e-9a3c-4428-b8b7-5033fddb73ef tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.183184 Sep 22 17:13:13.424310 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 363/728] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:13 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:13.430225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:13.431071 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:13.438524 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:13.439000 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:13.439433 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:13.440126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:13.440600 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:13.441013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:13.586765 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:13.597395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:13.599096 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:13.600267 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fb63fef1-98cb-481d-8321-24bdec7a29cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1807 microversion: 2.20 time: 0.175029 Sep 22 17:13:13.600832 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 364/729] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:13 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:14.029477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b14da0d1-502a-47ba-9fb7-b8f87c9b8258 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.080295 Sep 22 17:13:14.035980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 366/730] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:13:12 2022] POST /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments => generated 194 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:13:14.457735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:14.459028 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:14.465586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:14.466069 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:14.466503 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:14.467240 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:14.467696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:14.468124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:14.604903 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:14.607164 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:14.614776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-41991125-f1e1-476b-9040-0ef8d60e9af4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.160340 Sep 22 17:13:14.615574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 365/731] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:14 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:14.634066 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:14.634768 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:14.641481 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:14.641737 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:14.642166 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:14.642870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:14.643387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:14.643809 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:14.788974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:14.798016 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:14.799696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:14.800873 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-63847f38-aa17-47c0-a7db-5b21b30f8c26 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1794 microversion: 2.20 time: 0.172311 Sep 22 17:13:14.801431 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 367/732] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:13:14 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:13:15.641674 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:15.642324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:15.649248 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:15.649724 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:15.650153 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:15.650835 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:15.651331 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:15.651766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:15.820331 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:15.829454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a01c281e-9b3d-4aec-9d89-78eebcc5fdf8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.192325 Sep 22 17:13:15.830044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 366/733] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:15 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:16.853536 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:16.854143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:16.862070 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:16.862556 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:16.863042 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:16.863759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:16.864742 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:16.865167 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:16.984139 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-add8c753-3c8d-4387-aa25-091e2f147fc0 req-c51eca72-bc12-43bd-aa61-84199d221fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b", "name": "network-vif-plugged", "status": "completed", "tag": "5886ff66-8e7f-4da4-960b-035ee76660f1"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:16.995286 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-add8c753-3c8d-4387-aa25-091e2f147fc0 req-c51eca72-bc12-43bd-aa61-84199d221fc0 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:16.995680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-add8c753-3c8d-4387-aa25-091e2f147fc0 req-c51eca72-bc12-43bd-aa61-84199d221fc0 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:16.996173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-add8c753-3c8d-4387-aa25-091e2f147fc0 req-c51eca72-bc12-43bd-aa61-84199d221fc0 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:17.012400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-add8c753-3c8d-4387-aa25-091e2f147fc0 req-c51eca72-bc12-43bd-aa61-84199d221fc0 service nova] Creating event network-vif-plugged:5886ff66-8e7f-4da4-960b-035ee76660f1 for instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b on hv-cinder-83538 Sep 22 17:13:17.013376 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:17.021409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-add8c753-3c8d-4387-aa25-091e2f147fc0 req-c51eca72-bc12-43bd-aa61-84199d221fc0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107550 Sep 22 17:13:17.021999 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6432c392-571a-410d-95b8-9f250d19c3f6 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.172265 Sep 22 17:13:17.022567 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 367/735] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:13:17.022769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 368/735] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:16 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:18.045754 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:18.046387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:18.053080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:18.053563 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:18.053993 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:18.054692 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:18.055172 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:18.055594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:18.196775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:18.205240 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-67bdfe6f-540e-4397-9532-aefa02daa7e8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.163258 Sep 22 17:13:18.205840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 369/736] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:18 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:19.246886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:19.248613 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:19.256315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:19.256810 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:19.257252 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:19.257957 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:19.258414 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:19.258839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:19.475913 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:19.483816 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1e97034d-2094-40f4-b89d-cd8d9cc88db8 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1357 microversion: 2.1 time: 0.242239 Sep 22 17:13:19.484376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 368/737] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:19 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:20.342017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:20.342535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:20.348432 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:20.348914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:20.349344 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:20.350034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:20.350478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:20.350892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:20.437300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lazy-loading 'services' on Instance uuid 979379b2-1673-4425-be3f-98d99729db47 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:13:20.509931 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:20.511560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:20.519357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:20.521025 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:20.521930 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:20.522828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:20.523466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:20.524040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:20.530984 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dacc19e5-908f-4ed7-b7ac-e389db4426c8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/os-volume_attachments/9acd6c25-706b-4eaf-9b77-fa9cd1dfeba5" status: 202 len: 0 microversion: 2.1 time: 0.295517 Sep 22 17:13:20.531608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 370/738] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:13:20 2022] DELETE /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/os-volume_attachments/9acd6c25-706b-4eaf-9b77-fa9cd1dfeba5 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 17:13:20.664996 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:20.672839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-088cf895-97d6-4809-8808-a8cd31c4fe26 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1546 microversion: 2.1 time: 0.169138 Sep 22 17:13:20.673428 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 369/739] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:20 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:20.696633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:20.697324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:20.703482 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:20.703963 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:20.704394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:20.705081 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:20.705534 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:20.705951 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:20.843723 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:20.852188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-197af0ca-5dc1-42f7-a3c5-47a92bdda20c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1546 microversion: 2.1 time: 0.160255 Sep 22 17:13:20.852774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 371/740] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:20 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:20.875473 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:20.880920 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:20.881677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Searching by: {'deleted': False, 'project_id': '0749b2616b854791aec389d669ef94c8'} {{(pid=120804) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 22 17:13:20.889314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:20.889788 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:20.890285 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:20.891108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:20.891677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:20.892096 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:20.983639 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.multi_cell_list [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120804) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 22 17:13:21.092570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ba0ec9db-48d0-44e3-a93a-4d6821eee326 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.221517 Sep 22 17:13:21.093333 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 370/741] 10.222.0.16 () {58 vars in 1125 bytes} [Thu Sep 22 17:13:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:13:21.106001 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:21.107699 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:21.112897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:21.113381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:21.114417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:21.115175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:21.115619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:21.116036 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:21.262515 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:21.270818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5075311e-97d1-4b43-b89f-2e6c44425145 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1546 microversion: 2.1 time: 0.168864 Sep 22 17:13:21.271437 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 372/742] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:21 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:22.689753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:22.692395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:22.699368 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:22.699952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:22.700433 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:22.701210 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:22.701741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:22.702250 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:22.736108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lazy-loading 'flavor' on Instance uuid 273ac187-4613-4832-a9a4-4cf53828d55f {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:13:22.858935 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-09365ad5-4460-4071-8881-5f9de7361db2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e797a82b-9146-48fe-afe8-e42b65760fde"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:22.861420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-09365ad5-4460-4071-8881-5f9de7361db2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:22.868609 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09365ad5-4460-4071-8881-5f9de7361db2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:22.869180 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09365ad5-4460-4071-8881-5f9de7361db2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:22.869778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09365ad5-4460-4071-8881-5f9de7361db2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:22.870635 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09365ad5-4460-4071-8881-5f9de7361db2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:22.871179 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09365ad5-4460-4071-8881-5f9de7361db2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:22.871607 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-09365ad5-4460-4071-8881-5f9de7361db2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:22.888666 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e89a5e4b-b18c-4a76-ac1c-08afba83f8b5 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/action" status: 200 len: 32 microversion: 2.1 time: 0.202869 Sep 22 17:13:22.889286 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 371/743] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:13:22 2022] POST /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 17:13:22.899584 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:22.900346 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:22.906645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:22.907193 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:22.907576 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:22.908260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:22.908708 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:22.909122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:23.056754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:23.067032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-803fb340-bc81-44a6-84e5-a7910a76bb13 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.170643 Sep 22 17:13:23.067841 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 372/744] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:22 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:23.292844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-09365ad5-4460-4071-8881-5f9de7361db2 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "POST /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437770 Sep 22 17:13:23.293475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 373/745] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:13:22 2022] POST /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:13:24.093751 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:24.094890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:24.103768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:24.104254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:24.104705 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:24.105384 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:24.105833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:24.106277 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:24.274471 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:24.284358 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e317f337-08dc-44e6-9263-5f6378a3d3b3 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.196339 Sep 22 17:13:24.284947 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 373/746] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:24 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:24.856516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9707f1c8-57e9-49f4-9b67-131a8cd99959 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:24.858652 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=48 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:24.864991 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9707f1c8-57e9-49f4-9b67-131a8cd99959 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:24.865472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9707f1c8-57e9-49f4-9b67-131a8cd99959 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:24.865909 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9707f1c8-57e9-49f4-9b67-131a8cd99959 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:24.888907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9707f1c8-57e9-49f4-9b67-131a8cd99959 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Going to try to stop instance {{(pid=120805) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 22 17:13:24.933365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9707f1c8-57e9-49f4-9b67-131a8cd99959 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/action" status: 202 len: 0 microversion: 2.1 time: 0.081255 Sep 22 17:13:24.933980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 374/747] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:13:24 2022] POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:13:24.942608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:24.943243 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:24.949335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:24.949861 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:24.950256 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:24.950964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:24.951437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:24.951854 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:25.089212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:25.101361 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0efc2e5b-6b9a-4253-8fb2-a49f8a20c255 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.162591 Sep 22 17:13:25.102104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 374/748] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:24 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:25.308602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:25.309467 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:25.316168 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:25.316683 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:25.317075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:25.317769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:25.318207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:25.318622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:25.455632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:25.466592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-73a53da6-148f-45d3-89de-542b25912334 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.162183 Sep 22 17:13:25.483212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 375/749] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:25 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:26.125622 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:26.126161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:26.132837 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:26.133320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:26.133758 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:26.134452 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:26.134902 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:26.135353 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:26.268859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:26.277615 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4b334712-691e-4002-8773-6ce993303bc9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.155912 Sep 22 17:13:26.278188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 375/750] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:26 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:26.491484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:26.492103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:26.498452 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:26.498939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:26.499413 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:26.500112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:26.500599 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:26.501088 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:26.630471 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:26.638658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e8e71722-0cca-42d2-a858-743592fd7d80 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.151584 Sep 22 17:13:26.639340 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 376/751] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:26 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:27.300909 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:27.302135 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:27.308609 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:27.309119 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:27.309529 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:27.310229 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:27.310682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:27.311136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:27.457095 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:27.467846 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e64d787e-544a-4d4c-8525-44bd3b04e1eb tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.170946 Sep 22 17:13:27.468446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 376/752] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:27 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:27.663420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:27.664028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:27.670334 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:27.670810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:27.671274 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:27.671952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:27.672398 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:27.672815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:27.803492 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:27.807071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:27.812901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0040dc75-6b28-4a7a-9dc5-7ac374bc69a0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.153959 Sep 22 17:13:27.813470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 377/753] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:27 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:28.492104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:28.492707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:28.499189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:28.499676 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:28.500112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:28.500828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:28.501281 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:28.501705 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:28.642908 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:28.651354 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-02279b6b-2723-477e-a7a7-5819d3bc97b4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.163127 Sep 22 17:13:28.652332 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 377/754] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:28 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:28.837298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:28.837898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:28.844972 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:28.845484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:28.845912 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:28.846600 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:28.847144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:28.847568 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:28.984854 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:28.993546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-43c259c9-b44c-4f81-8666-9822363a56ad tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.160896 Sep 22 17:13:28.994133 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 378/755] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:28 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:29.675145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:29.675764 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:29.682287 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:29.682771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:29.683238 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:29.683934 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:29.684386 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:29.684807 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:29.814820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:29.822487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-04099b6b-73c9-445b-ba0f-d198c4fa859d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.151684 Sep 22 17:13:29.823059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 378/756] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:29 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:30.017356 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:30.017956 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:30.024963 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:30.025439 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:30.025868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:30.026541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:30.027011 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:30.027432 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:30.159573 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:30.167640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2bef7ae8-4c37-402c-b892-ee07670f62cb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.154138 Sep 22 17:13:30.168207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 379/757] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:30 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:30.845457 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:30.846059 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:30.852989 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:30.853498 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:30.853926 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:30.854599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:30.855075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:30.855491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:30.922911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:30.996237 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:31.004454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3768b799-4161-4a29-acea-d8f0c67ed61b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.162573 Sep 22 17:13:31.005057 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 379/758] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:30 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:31.191992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:31.192629 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:31.199721 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:31.200417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:31.200932 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:31.201814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:31.202405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:31.202914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:31.355946 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:31.365798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b9b97fda-4f14-45ca-a747-ce1b72928623 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.178580 Sep 22 17:13:31.366250 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 380/759] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:31 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:32.027033 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:32.027604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:32.034402 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:32.034890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:32.035997 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:32.036708 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:32.037154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:32.037572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:32.118654 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:32.119286 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:32.125137 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:32.125616 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:32.126066 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:32.126735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:32.127209 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:32.127631 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:32.179899 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:32.182144 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:32.190061 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-02a1d729-fc9a-482c-931b-bf39191cd908 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.166924 Sep 22 17:13:32.190654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 380/760] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:32 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:32.263091 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:32.272394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-74f5dcf0-f28e-473e-9784-1c48a5a87ce4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1592 microversion: 2.1 time: 0.157522 Sep 22 17:13:32.273180 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 381/761] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:32 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1592 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:32.389815 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:32.390425 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:32.398853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:32.399438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:32.400023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:32.400931 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:32.401579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:32.402085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:32.541230 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:32.550290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-28c195ce-7b7a-4552-9154-7e89fa2be10c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.164568 Sep 22 17:13:32.551434 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 381/762] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:32 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:33.214508 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:33.215542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:33.222706 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:33.223228 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:33.223650 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:33.224353 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:33.224804 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:33.225220 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:33.374461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:33.383659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f418e274-dfc8-443c-a835-cf1a2f34e9fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.173021 Sep 22 17:13:33.384316 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 382/763] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:33 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:33.578040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:33.578641 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:33.585949 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:33.586431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:33.586885 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:33.587594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:33.588045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:33.588464 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:33.724401 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:33.732579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c6e717d4-d778-4446-9602-ec06e9821aff tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.158342 Sep 22 17:13:33.733185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 382/764] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:33 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:33.996083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-da3942c7-5d37-4455-bbdc-97daed3769de req-f39770a4-4cbc-40ca-b377-d7028f76fa68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b", "tag": "5886ff66-8e7f-4da4-960b-035ee76660f1"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:34.006199 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-da3942c7-5d37-4455-bbdc-97daed3769de req-f39770a4-4cbc-40ca-b377-d7028f76fa68 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:34.006681 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-da3942c7-5d37-4455-bbdc-97daed3769de req-f39770a4-4cbc-40ca-b377-d7028f76fa68 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:34.007316 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-da3942c7-5d37-4455-bbdc-97daed3769de req-f39770a4-4cbc-40ca-b377-d7028f76fa68 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:34.019760 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-da3942c7-5d37-4455-bbdc-97daed3769de req-f39770a4-4cbc-40ca-b377-d7028f76fa68 service nova] Creating event network-changed:5886ff66-8e7f-4da4-960b-035ee76660f1 for instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b on hv-cinder-83538 Sep 22 17:13:34.025029 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-da3942c7-5d37-4455-bbdc-97daed3769de req-f39770a4-4cbc-40ca-b377-d7028f76fa68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032472 Sep 22 17:13:34.025942 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 383/765] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:13:34.408358 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:34.409481 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:34.416608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:34.417210 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:34.417749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:34.418549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:34.419225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:34.419812 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:34.675624 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:34.690280 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9abc89e1-2884-4270-a480-9101586ad2bc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.285690 Sep 22 17:13:34.690938 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 383/766] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:34 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:34.758580 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:34.759143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:34.766683 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:34.767181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:34.767618 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:34.768555 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:34.769182 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:34.770297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:35.028741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:35.044996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0ca6d48f-2b8e-47d5-a573-6a3ff4e0f5bc tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.292029 Sep 22 17:13:35.046973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 384/767] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:34 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:35.627970 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-134821247"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:35.628503 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:35.636267 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:35.636768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:35.637186 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:35.637884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:35.638330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:35.638751 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:35.719455 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:35.720071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:35.727961 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:35.728542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:35.729056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:35.729808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:35.730318 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:35.730832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:35.810730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.network.security_group_api [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Adding security group 29fa356b-5477-44d1-8eab-bec3a18b8ba0 to port 5886ff66-8e7f-4da4-960b-035ee76660f1 Sep 22 17:13:35.952599 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:35.961639 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-96083ffa-3c4f-441b-9a77-6df490f9efd6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.247308 Sep 22 17:13:35.962422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 385/768] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:35 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:36.074044 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:36.074815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:36.080916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:36.081428 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:36.081866 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:36.083015 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:36.086056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:36.086565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:36.255710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-98a374dc-4364-4983-bb71-d751acaace63 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "POST /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/action" status: 202 len: 0 microversion: 2.1 time: 0.631672 Sep 22 17:13:36.256326 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 384/769] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:13:35 2022] POST /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:13:36.265941 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:36.266869 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:36.274130 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:36.274624 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:36.275126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:36.275829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:36.276282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:36.276703 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:36.296888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:36.308233 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2a2fb683-92fa-45d0-b3eb-ef3daf859f3b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.238224 Sep 22 17:13:36.309049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 386/770] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:36 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:36.452407 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-30eab96d-cccf-424d-aecd-66ed017768bd req-6f61e6d6-7e9f-4fde-bc85-97980c1d60fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b", "tag": "5886ff66-8e7f-4da4-960b-035ee76660f1"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:36.462496 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-30eab96d-cccf-424d-aecd-66ed017768bd req-6f61e6d6-7e9f-4fde-bc85-97980c1d60fd service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:36.463002 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-30eab96d-cccf-424d-aecd-66ed017768bd req-6f61e6d6-7e9f-4fde-bc85-97980c1d60fd service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:36.463332 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:36.463461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-30eab96d-cccf-424d-aecd-66ed017768bd req-6f61e6d6-7e9f-4fde-bc85-97980c1d60fd service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:36.472215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c6608f4f-2c13-4411-aee6-58f27ddaf829 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1756 microversion: 2.1 time: 0.211391 Sep 22 17:13:36.485297 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 385/771] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:36 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:36.487640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-30eab96d-cccf-424d-aecd-66ed017768bd req-6f61e6d6-7e9f-4fde-bc85-97980c1d60fd service nova] Creating event network-changed:5886ff66-8e7f-4da4-960b-035ee76660f1 for instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b on hv-cinder-83538 Sep 22 17:13:36.493360 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-30eab96d-cccf-424d-aecd-66ed017768bd req-6f61e6d6-7e9f-4fde-bc85-97980c1d60fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183394 Sep 22 17:13:36.494216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 387/772] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:13:36.986446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:36.987034 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:36.994234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:36.994719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:36.995182 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:36.995873 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:36.996352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:36.996740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:37.193187 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:37.202017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7f78b352-18c7-478e-966f-8342f8cf7a29 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.219954 Sep 22 17:13:37.202718 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 386/773] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:36 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:37.336302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:37.336924 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:37.343158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:37.343633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:37.344062 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:37.344739 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:37.345186 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:37.345606 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:37.481300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:37.502465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7a948a5f-c8cf-429f-a6cc-2a1bc8b83d60 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.170734 Sep 22 17:13:37.503411 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 388/774] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:37 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:38.225799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:38.226407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:38.232833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:38.233313 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:38.233750 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:38.234437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:38.234891 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:38.235344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:38.364987 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:38.372662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2ca06bd0-6f40-4612-adfb-de72f008fde8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.151326 Sep 22 17:13:38.373235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 387/775] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:38 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:38.526295 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:38.527004 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:38.533470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:38.533948 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:38.534379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:38.535089 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:38.535539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:38.535961 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:38.667582 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:38.676108 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6e4ba3cb-f379-432f-b124-de52b77fdedd tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.153759 Sep 22 17:13:38.676683 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 389/776] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:38 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:39.396141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:39.397236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:39.405514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:39.406020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:39.406446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:39.407403 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:39.408036 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:39.408533 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:39.540603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:39.549016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-121faac6-863b-47b5-9f13-f975d155989f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.157701 Sep 22 17:13:39.549584 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 388/777] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:39 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:39.701010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:39.702056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:39.709510 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:39.709995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:39.710430 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:39.711171 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:39.711628 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:39.712093 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:39.853995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:39.864861 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aaa328df-d66c-4f59-9771-9d6f64761e36 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.168435 Sep 22 17:13:39.865943 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 390/778] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:39 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:40.572923 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:40.573543 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:40.579748 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:40.580415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:40.580855 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:40.583509 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:40.584075 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:40.584511 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:40.717389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:40.726515 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9bee8bf8-b306-4e92-8931-1d8eb2d44b8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.157424 Sep 22 17:13:40.727116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 389/779] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:40 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:40.890054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:40.890592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:40.897436 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:40.898286 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:40.899017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:40.900051 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:40.900515 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:40.900948 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:41.033818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:41.041955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a7d9a1cb-5bcc-44ac-ab88-5b2ab1e9158c tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.155875 Sep 22 17:13:41.042704 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 391/780] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:40 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:41.749938 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:41.751255 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:41.754840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=58 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:41.760871 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:41.761373 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:41.761883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:41.762596 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:41.763077 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:41.763504 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:41.899047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:41.906917 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-08e0b0e1-590a-4a4b-9a23-419050664f0e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.160941 Sep 22 17:13:41.906917 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 390/781] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:41 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:42.066470 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:42.067113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:42.073717 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:42.074199 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:42.074631 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:42.075367 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:42.075822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:42.076239 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:42.209048 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:42.217301 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1394efc7-0911-4d66-b673-6f72fa514303 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.155380 Sep 22 17:13:42.217870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 392/782] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:42 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:42.932019 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:42.932627 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:42.939008 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:42.939489 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:42.939924 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:42.940608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:42.941407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:42.941834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:43.074249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:43.082856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d76403d1-9262-48b0-9bd2-b78861198e2f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.154604 Sep 22 17:13:43.083468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 391/783] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:42 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:43.245707 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:43.246312 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:43.252821 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:43.253302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:43.254388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:43.255102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:43.255557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:43.255971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:43.391682 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:43.400270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9d13a1d6-93f9-4d7f-95ed-5a742faccfb9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1734 microversion: 2.1 time: 0.158482 Sep 22 17:13:43.401126 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 393/784] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:43 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:44.108895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:44.109694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:44.119158 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.119650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.120130 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:44.120820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.121447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.122103 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:44.253259 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:44.261441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-88194926-0878-4158-9a3e-129116c173fa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.157595 Sep 22 17:13:44.262013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 392/785] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:44 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:44.423617 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:44.424168 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:44.430411 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.430893 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.431423 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:44.432098 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.432548 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.432962 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:44.567971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:44.576106 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d357aad7-b355-4b3d-bf40-b704a12e677f tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1714 microversion: 2.1 time: 0.156734 Sep 22 17:13:44.576679 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 394/786] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:44 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:44.639135 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:44.639726 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:44.645628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.646107 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.646634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:44.647351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.647805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.648225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:44.731775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] HTTP exception thrown: Cannot 'detach_volume' instance 273ac187-4613-4832-a9a4-4cf53828d55f while it is in vm_state rescued Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Request method failure captured: Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: DELETE /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments/f1baa4f1-89d9-49f5-a443-2f0f6e979ce2 HTTP/1.1 Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZTAFlLOJ4rlDfvtbyAuZ9FrBVULX3z83mdChpvcMKbEkHMTeqCkKMuDbiHkNn6OCActvwzsE_8Ru8WCEkA81Gs5jE3Dw2LR0eZwmLDDH1jY43QhcF4N-enqNZnxT1FGdBFnYdADAdXOM3mkbqkGHXLnwDMa-jzgA_ra6k4l1Dg8N8 Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:13:44.733404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_105c11557b6f45329dc97af01e8ea915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: bc8c2a5413c943ed94d76eceb2720f17 Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:13:44.735078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Cannot 'detach_volume' instance 273ac187-4613-4832-a9a4-4cf53828d55f while it is in vm_state rescued Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'server_id': '273ac187-4613-4832-a9a4-4cf53828d55f', 'id': 'f1baa4f1-89d9-49f5-a443-2f0f6e979ce2'} Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 273ac187-4613-4832-a9a4-4cf53828d55f in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:13:44.735943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 273ac187-4613-4832-a9a4-4cf53828d55f while it is in vm_state rescued Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 273ac187-4613-4832-a9a4-4cf53828d55f while it is in vm_state rescued Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:44.737438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Returning 409 to user: Cannot 'detach_volume' instance 273ac187-4613-4832-a9a4-4cf53828d55f while it is in vm_state rescued {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:13:44.738613 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-868d1f26-763f-4076-97d7-64f6a22d3a65 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "DELETE /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments/f1baa4f1-89d9-49f5-a443-2f0f6e979ce2" status: 409 len: 152 microversion: 2.1 time: 0.099666 Sep 22 17:13:44.738613 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 393/787] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:13:44 2022] DELETE /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments/f1baa4f1-89d9-49f5-a443-2f0f6e979ce2 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 22 17:13:44.744139 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-601377a8-4597-420e-9df6-0eca330f86f4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:44.744698 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-601377a8-4597-420e-9df6-0eca330f86f4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:44.750543 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-601377a8-4597-420e-9df6-0eca330f86f4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.751072 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-601377a8-4597-420e-9df6-0eca330f86f4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.751504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-601377a8-4597-420e-9df6-0eca330f86f4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:44.752819 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-601377a8-4597-420e-9df6-0eca330f86f4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.753284 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-601377a8-4597-420e-9df6-0eca330f86f4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.753731 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-601377a8-4597-420e-9df6-0eca330f86f4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:44.780785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:44.820719 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-601377a8-4597-420e-9df6-0eca330f86f4 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "POST /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/action" status: 202 len: 0 microversion: 2.1 time: 0.080443 Sep 22 17:13:44.821385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 395/788] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:13:44 2022] POST /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:13:44.829828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:44.830621 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:44.838010 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.838622 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.839139 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:44.839905 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:44.840522 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:44.841011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:45.058251 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:45.066519 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-361d9a41-a1a0-4b1a-ad50-78ce68fed086 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1722 microversion: 2.1 time: 0.240823 Sep 22 17:13:45.067122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 394/789] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:44 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:45.285613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:45.286306 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:45.292403 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:45.292880 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:45.293306 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:45.293995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:45.294481 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:45.294897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:45.423202 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:45.431796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cff55560-cc96-47fa-97d9-a42d8d6a8139 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1677 microversion: 2.1 time: 0.150511 Sep 22 17:13:45.432389 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 396/790] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:45 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:46.089825 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:46.090470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:46.097750 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:46.098234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:46.098680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:46.100195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:46.100651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:46.101080 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:46.232796 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:46.241555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-494b5769-3cf1-4d72-b9cf-83da4dc53fbb tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1722 microversion: 2.1 time: 0.155686 Sep 22 17:13:46.242100 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 395/791] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:46 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:46.456006 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:46.457211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:46.463772 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:46.464253 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:46.464693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:46.465387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:46.465835 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:46.466252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:46.597441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:46.605435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a8c1199d-90b0-4ee4-a2c9-5f36d63c5d6a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1654 microversion: 2.1 time: 0.153286 Sep 22 17:13:46.606035 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 397/792] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:46 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:46.629315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8631948a-528f-4f68-bb05-6b68b6c5c859 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:46.635992 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8631948a-528f-4f68-bb05-6b68b6c5c859 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:46.636479 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8631948a-528f-4f68-bb05-6b68b6c5c859 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:46.636909 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8631948a-528f-4f68-bb05-6b68b6c5c859 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:46.661886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8631948a-528f-4f68-bb05-6b68b6c5c859 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Going to try to start instance {{(pid=120804) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 22 17:13:46.697915 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:46.711178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8631948a-528f-4f68-bb05-6b68b6c5c859 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/action" status: 202 len: 0 microversion: 2.1 time: 0.086249 Sep 22 17:13:46.711800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 396/793] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:13:46 2022] POST /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:13:46.722049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:46.722049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:46.727677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:46.728167 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:46.728598 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:46.729299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:46.729744 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:46.730158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:46.870675 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:46.878983 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-45cdda94-1ce2-4a97-8cd4-e5272cf1bcf8 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1663 microversion: 2.1 time: 0.162104 Sep 22 17:13:46.879560 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 398/794] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:46 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:47.265292 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:47.266012 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:47.273258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:47.273729 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:47.274155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:47.274838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:47.275334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:47.275753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:47.410348 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:47.418894 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b2654c51-dd45-40a9-a3ef-5303e9fb7165 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1722 microversion: 2.1 time: 0.157991 Sep 22 17:13:47.419627 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 397/795] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:47 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:47.901679 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:47.902391 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:47.908785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:47.909266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:47.910237 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:47.910913 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:47.911417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:47.911829 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:48.041460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:48.049851 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-493c5fc8-915c-4ecc-9221-ff8ab1099e5d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1663 microversion: 2.1 time: 0.151989 Sep 22 17:13:48.050980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 399/796] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:47 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:48.444419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:48.445117 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:48.451637 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:48.452118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:48.452551 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:48.453242 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:48.453691 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:48.454110 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:48.589189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:48.601235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d9b8f990-2801-45a1-b214-ab3fd9fb5ef6 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1722 microversion: 2.1 time: 0.161666 Sep 22 17:13:48.601975 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 398/797] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:48 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:49.074262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:49.074835 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:49.081247 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:49.081731 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:49.082218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:49.082921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:49.083434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:49.083862 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:49.218522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:49.226166 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3c4fc8ce-c96c-4726-bb27-283f15f73144 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1663 microversion: 2.1 time: 0.155960 Sep 22 17:13:49.226740 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 400/798] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:49 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:49.626778 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:49.627860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:49.634484 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:49.635235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:49.635668 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:49.636528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:49.636997 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:49.637395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:49.849228 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:49.857514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4a76f5b3-9881-42b3-a00c-f3c2b8804b71 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1728 microversion: 2.1 time: 0.235390 Sep 22 17:13:49.858094 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 399/799] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:49 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1728 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:49.880229 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-68a26198-d35b-42a6-928c-2b177315e07d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:49.880725 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-68a26198-d35b-42a6-928c-2b177315e07d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:49.886619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-68a26198-d35b-42a6-928c-2b177315e07d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:49.887154 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-68a26198-d35b-42a6-928c-2b177315e07d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:49.887595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-68a26198-d35b-42a6-928c-2b177315e07d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:49.888293 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-68a26198-d35b-42a6-928c-2b177315e07d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:49.888750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-68a26198-d35b-42a6-928c-2b177315e07d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:49.889172 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-68a26198-d35b-42a6-928c-2b177315e07d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:49.988150 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-68a26198-d35b-42a6-928c-2b177315e07d tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111796 Sep 22 17:13:49.988753 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 401/800] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 22 17:13:49 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:13:50.250665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:50.251226 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:50.259540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:50.259881 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:50.260320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:50.261031 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:50.261510 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:50.261928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:50.520618 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:50.528237 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-13d71009-645e-475e-82b4-e300469bd910 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1663 microversion: 2.1 time: 0.281628 Sep 22 17:13:50.528810 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 400/801] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:50 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1663 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:51.186890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-3875c0f8-a2de-4757-9f53-0269c2908763 req-6aeb168f-8aa8-4870-a60b-3cccb97b23d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273ac187-4613-4832-a9a4-4cf53828d55f", "tag": "f2393791-4dcd-48e5-ab8f-65b3058fd17e"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:51.198326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3875c0f8-a2de-4757-9f53-0269c2908763 req-6aeb168f-8aa8-4870-a60b-3cccb97b23d7 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:51.198814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3875c0f8-a2de-4757-9f53-0269c2908763 req-6aeb168f-8aa8-4870-a60b-3cccb97b23d7 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:51.199274 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-3875c0f8-a2de-4757-9f53-0269c2908763 req-6aeb168f-8aa8-4870-a60b-3cccb97b23d7 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:51.212079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-3875c0f8-a2de-4757-9f53-0269c2908763 req-6aeb168f-8aa8-4870-a60b-3cccb97b23d7 service nova] Creating event network-changed:f2393791-4dcd-48e5-ab8f-65b3058fd17e for instance 273ac187-4613-4832-a9a4-4cf53828d55f on hv-cinder-83538 Sep 22 17:13:51.221033 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-3875c0f8-a2de-4757-9f53-0269c2908763 req-6aeb168f-8aa8-4870-a60b-3cccb97b23d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038449 Sep 22 17:13:51.222428 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 402/802] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:13:51.552878 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:51.554085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:51.561617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:51.562322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:51.563129 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:51.564014 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:51.564681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:51.565446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:51.786095 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:51.794667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c8e9095d-e005-4fd4-8e9b-39bbf816f95f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1667 microversion: 2.1 time: 0.246525 Sep 22 17:13:51.795366 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 401/803] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:51 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1667 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:52.858033 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-536b471a-4565-4170-b366-41cc32bdc6ff tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:52.858618 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-536b471a-4565-4170-b366-41cc32bdc6ff tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:52.864860 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-536b471a-4565-4170-b366-41cc32bdc6ff tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:52.865332 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-536b471a-4565-4170-b366-41cc32bdc6ff tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:52.865762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-536b471a-4565-4170-b366-41cc32bdc6ff tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:52.866447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-536b471a-4565-4170-b366-41cc32bdc6ff tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:52.866897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-536b471a-4565-4170-b366-41cc32bdc6ff tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:52.867345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-536b471a-4565-4170-b366-41cc32bdc6ff tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:52.889727 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-536b471a-4565-4170-b366-41cc32bdc6ff tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa/ips" status: 200 len: 150 microversion: 2.1 time: 0.134436 Sep 22 17:13:52.890272 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 403/804] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:13:52 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa/ips => generated 150 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:13:52.902441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcad51fd-ddfd-42f6-97db-7b12fcde8bfd"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:52.904926 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:52.912072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:52.912556 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:52.912993 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:52.913683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:52.914135 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:52.914557 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:52.993529 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Invalid volume: volume dcad51fd-ddfd-42f6-97db-7b12fcde8bfd is already attached to instances: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: POST /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa/os-volume_attachments HTTP/1.1 Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 74 Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:13:52.995295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {"volumeAttachment": {"volumeId": "dcad51fd-ddfd-42f6-97db-7b12fcde8bfd"}} Sep 22 17:13:52.996865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Invalid volume: volume dcad51fd-ddfd-42f6-97db-7b12fcde8bfd is already attached to instances: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'server_id': 'ae76e1d7-dddd-4528-979a-025f671185aa', 'body': {'volumeAttachment': {'volumeId': 'dcad51fd-ddfd-42f6-97db-7b12fcde8bfd'}}} Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dcad51fd-ddfd-42f6-97db-7b12fcde8bfd is already attached to instances: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:52.997860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dcad51fd-ddfd-42f6-97db-7b12fcde8bfd is already attached to instances: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:13:52.999337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:13:53.000856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:13:53.000856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:13:53.000856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:13:53.000856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dcad51fd-ddfd-42f6-97db-7b12fcde8bfd is already attached to instances: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 Sep 22 17:13:53.000856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:13:53.000856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 400 to user: Invalid volume: volume dcad51fd-ddfd-42f6-97db-7b12fcde8bfd is already attached to instances: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:13:53.000856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-59f0496c-f4e4-4e74-a4a7-4bb6178bf259 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098297 Sep 22 17:13:53.000856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 402/805] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:13:52 2022] POST /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:13:53.005967 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:53.006459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:53.012326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:53.012803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:53.013232 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:53.013918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:53.014371 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:53.014813 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:53.040376 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:13:53.126194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b8c82b21-9271-4da4-9994-88f32fd39530 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 204 len: 0 microversion: 2.1 time: 0.123949 Sep 22 17:13:53.126786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 404/806] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:13:53 2022] DELETE /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:13:53.135198 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:53.135808 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:53.142514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:53.143029 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:53.143462 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:53.144710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:53.145206 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:53.145675 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:53.236700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-c3c7aba2-b7fe-4e82-a4d7-07221af32ba0 req-1cd56c17-c807-46af-a105-a74e28c7026d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273ac187-4613-4832-a9a4-4cf53828d55f", "tag": "f2393791-4dcd-48e5-ab8f-65b3058fd17e"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:53.246450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-c3c7aba2-b7fe-4e82-a4d7-07221af32ba0 req-1cd56c17-c807-46af-a105-a74e28c7026d service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:53.247049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-c3c7aba2-b7fe-4e82-a4d7-07221af32ba0 req-1cd56c17-c807-46af-a105-a74e28c7026d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:53.247546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-c3c7aba2-b7fe-4e82-a4d7-07221af32ba0 req-1cd56c17-c807-46af-a105-a74e28c7026d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:53.259461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-c3c7aba2-b7fe-4e82-a4d7-07221af32ba0 req-1cd56c17-c807-46af-a105-a74e28c7026d service nova] Creating event network-changed:f2393791-4dcd-48e5-ab8f-65b3058fd17e for instance 273ac187-4613-4832-a9a4-4cf53828d55f on hv-cinder-83538 Sep 22 17:13:53.265472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-c3c7aba2-b7fe-4e82-a4d7-07221af32ba0 req-1cd56c17-c807-46af-a105-a74e28c7026d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032766 Sep 22 17:13:53.266082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 405/807] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:13:53.295194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:53.303809 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ae20fd4f-52f7-4de3-97a3-66792a3e6499 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1682 microversion: 2.1 time: 0.172546 Sep 22 17:13:53.304374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 403/808] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:53 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:54.327988 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:54.328726 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:54.334939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:54.335461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:54.335893 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:54.336579 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:54.337034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:54.337456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:54.467315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:54.475043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-850cf8e6-1936-449e-acd8-6a98269ce673 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1682 microversion: 2.1 time: 0.151864 Sep 22 17:13:54.475619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 406/809] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:54 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:55.500080 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:55.500817 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:55.508787 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:55.509371 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:55.509797 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:55.510499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:55.510971 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:55.511387 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:55.797218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:55.805830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-78b7827c-aa81-422a-9e1c-1fda78ac01fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1682 microversion: 2.1 time: 0.309986 Sep 22 17:13:55.806416 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 404/810] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:55 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1682 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:13:56.586847 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-a4fd870e-732f-41a5-afa8-464dae2e48b9 req-dea08b7a-e5e0-4b43-817e-1fc8d99c984b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae76e1d7-dddd-4528-979a-025f671185aa", "name": "network-vif-deleted", "tag": "a525dbad-0b77-49f5-92d5-87d346a4de53"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:13:56.592674 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:13:56.602661 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a4fd870e-732f-41a5-afa8-464dae2e48b9 req-dea08b7a-e5e0-4b43-817e-1fc8d99c984b service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:56.603298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a4fd870e-732f-41a5-afa8-464dae2e48b9 req-dea08b7a-e5e0-4b43-817e-1fc8d99c984b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:56.603740 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-a4fd870e-732f-41a5-afa8-464dae2e48b9 req-dea08b7a-e5e0-4b43-817e-1fc8d99c984b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:56.617969 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-a4fd870e-732f-41a5-afa8-464dae2e48b9 req-dea08b7a-e5e0-4b43-817e-1fc8d99c984b service nova] Creating event network-vif-deleted:a525dbad-0b77-49f5-92d5-87d346a4de53 for instance ae76e1d7-dddd-4528-979a-025f671185aa on hv-cinder-83538 Sep 22 17:13:56.623879 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-a4fd870e-732f-41a5-afa8-464dae2e48b9 req-dea08b7a-e5e0-4b43-817e-1fc8d99c984b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040379 Sep 22 17:13:56.626059 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 407/811] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:13:56.838375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:56.838375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:56.846549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:56.847796 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:56.848195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:56.848918 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:56.849375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:56.849911 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:56.885695 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:56.886175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:56.886662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:56.887168 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'fault' on Instance uuid ae76e1d7-dddd-4528-979a-025f671185aa {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:13:56.930272 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:13:56.938172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d3f35925-13a2-4de4-b2af-b63034593c7a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 200 len: 1331 microversion: 2.1 time: 0.110435 Sep 22 17:13:56.938975 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 405/812] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:56 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:13:57.962734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:57.963464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:57.970705 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:57.971328 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:57.971765 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:57.972465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:57.972951 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:57.973376 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:57.987377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa HTTP/1.1 Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:13:57.989094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:13:57.990634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'ae76e1d7-dddd-4528-979a-025f671185aa'} Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:13:57.991619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:13:57.993138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:13:57.994497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:13:57.994497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-823ed123-d3fb-49a0-9c5f-bb4024fa60a5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 404 len: 111 microversion: 2.1 time: 0.031997 Sep 22 17:13:57.994497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 408/813] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:13:57 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:13:57.999611 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-19f7e253-4700-42fa-9675-ff41e66bafd2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '.version_select at 0x7f51d9239700>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:58.036411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-19f7e253-4700-42fa-9675-ff41e66bafd2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-732043597" status: 202 len: 0 microversion: 2.1 time: 0.040534 Sep 22 17:13:58.037018 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 406/814] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 22 17:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-732043597 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 17:13:58.746099 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:58.746595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:58.753793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:58.754278 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:58.754716 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:58.755444 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:58.755890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:58.756311 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:58.991688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'services' on Instance uuid 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:13:59.062302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e5284a35-0e9d-4972-b443-bce937c97588 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments/dcad51fd-ddfd-42f6-97db-7b12fcde8bfd" status: 202 len: 0 microversion: 2.1 time: 0.319945 Sep 22 17:13:59.062884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 409/815] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:13:58 2022] DELETE /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments/dcad51fd-ddfd-42f6-97db-7b12fcde8bfd => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:13:59.072527 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-dba54c27-d514-4c39-a5ca-6e9d474a54d5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:13:59.074786 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-dba54c27-d514-4c39-a5ca-6e9d474a54d5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:13:59.082204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dba54c27-d514-4c39-a5ca-6e9d474a54d5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:59.082697 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dba54c27-d514-4c39-a5ca-6e9d474a54d5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:59.083167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dba54c27-d514-4c39-a5ca-6e9d474a54d5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:59.083868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dba54c27-d514-4c39-a5ca-6e9d474a54d5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:13:59.084326 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dba54c27-d514-4c39-a5ca-6e9d474a54d5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:13:59.084758 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dba54c27-d514-4c39-a5ca-6e9d474a54d5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:13:59.116898 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-dba54c27-d514-4c39-a5ca-6e9d474a54d5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049148 Sep 22 17:13:59.117463 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 407/816] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:13:59 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:00.131045 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-467d112e-d99f-4452-a11d-65b35f1bac6e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:00.133232 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-467d112e-d99f-4452-a11d-65b35f1bac6e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:00.139280 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-467d112e-d99f-4452-a11d-65b35f1bac6e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:00.139766 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-467d112e-d99f-4452-a11d-65b35f1bac6e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:00.140214 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-467d112e-d99f-4452-a11d-65b35f1bac6e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:00.140886 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-467d112e-d99f-4452-a11d-65b35f1bac6e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:00.141332 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-467d112e-d99f-4452-a11d-65b35f1bac6e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:00.141741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-467d112e-d99f-4452-a11d-65b35f1bac6e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:00.172222 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-467d112e-d99f-4452-a11d-65b35f1bac6e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 Sep 22 17:14:00.173974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 410/817] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:14:00 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:01.186638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7cd7b741-4723-4a4f-bbe8-0d76130ba625 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:01.189162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7cd7b741-4723-4a4f-bbe8-0d76130ba625 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:01.196396 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7cd7b741-4723-4a4f-bbe8-0d76130ba625 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:01.196880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7cd7b741-4723-4a4f-bbe8-0d76130ba625 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:01.197316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7cd7b741-4723-4a4f-bbe8-0d76130ba625 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:01.198030 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7cd7b741-4723-4a4f-bbe8-0d76130ba625 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:01.198480 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7cd7b741-4723-4a4f-bbe8-0d76130ba625 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:01.198905 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7cd7b741-4723-4a4f-bbe8-0d76130ba625 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:01.227331 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7cd7b741-4723-4a4f-bbe8-0d76130ba625 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044586 Sep 22 17:14:01.227895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 408/818] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:14:01 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 17:14:01.297369 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:01.297925 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:01.305036 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:01.305522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:01.305959 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:01.306656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:01.307158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:01.307583 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:01.335711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:14:01.363512 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:01.416429 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a0d0891b-4c87-4205-8a67-30a2b5213752 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 204 len: 0 microversion: 2.1 time: 0.122437 Sep 22 17:14:01.417220 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 411/819] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:14:01 2022] DELETE /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:14:01.426576 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:01.427221 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:01.433225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:01.433742 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:01.434162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:01.434842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:01.435330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:01.435759 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:01.564138 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:01.571925 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c9d9ca38-fa6f-4cf7-a0a7-fc3ce91124fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1681 microversion: 2.1 time: 0.150350 Sep 22 17:14:01.572492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 409/820] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:01 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:14:02.595737 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:02.597050 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:02.603327 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:02.603801 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:02.604220 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:02.604896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:02.605338 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:02.605752 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:02.831722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:02.839494 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-389d5cd1-d807-473d-b540-d6ca38f55639 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1681 microversion: 2.1 time: 0.248010 Sep 22 17:14:02.840077 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 412/821] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:02 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:03.534754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-2528dd59-9a67-44ff-bdc4-0eaf19a88f87 req-04b8c3e0-20e9-4d32-947a-a7b7398d35ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f634f38-8ab0-4a46-a568-6bba89fc4bc3", "name": "network-vif-deleted", "tag": "7447a832-846a-4c07-be5a-552ef92f9902"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:03.546557 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-2528dd59-9a67-44ff-bdc4-0eaf19a88f87 req-04b8c3e0-20e9-4d32-947a-a7b7398d35ee service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:03.547066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-2528dd59-9a67-44ff-bdc4-0eaf19a88f87 req-04b8c3e0-20e9-4d32-947a-a7b7398d35ee service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:03.547700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-2528dd59-9a67-44ff-bdc4-0eaf19a88f87 req-04b8c3e0-20e9-4d32-947a-a7b7398d35ee service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:03.559497 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-2528dd59-9a67-44ff-bdc4-0eaf19a88f87 req-04b8c3e0-20e9-4d32-947a-a7b7398d35ee service nova] Creating event network-vif-deleted:7447a832-846a-4c07-be5a-552ef92f9902 for instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 on hv-cinder-83538 Sep 22 17:14:03.564666 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-2528dd59-9a67-44ff-bdc4-0eaf19a88f87 req-04b8c3e0-20e9-4d32-947a-a7b7398d35ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034265 Sep 22 17:14:03.565599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 410/822] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:03.863381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:03.864098 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:03.871269 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:03.871957 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:03.873365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:03.874079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:03.874690 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:03.875156 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:03.907995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:03.909191 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:03.909872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:03.910282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'fault' on Instance uuid 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:14:03.952463 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:03.960902 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d0f95a42-607a-477f-acaf-21d572a4b3e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 200 len: 1332 microversion: 2.1 time: 0.102407 Sep 22 17:14:03.961611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 413/823] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:03 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:04.986040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:04.986726 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:04.993628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:04.994188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:04.994762 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:04.995487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:04.995942 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:04.996368 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:05.010201 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 HTTP/1.1 Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:14:05.011840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:14:05.013466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '9f634f38-8ab0-4a46-a568-6bba89fc4bc3'} Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:14:05.014393 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:14:05.015980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:14:05.017304 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:14:05.017304 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4db1b6e3-4e93-49e1-a178-b8519d7cd28c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 404 len: 111 microversion: 2.1 time: 0.031918 Sep 22 17:14:05.017304 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 411/824] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:04 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:14:05.022297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8562e8a2-db13-4ef9-a321-215144b2c76c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '.version_select at 0x7f51d93f88b0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:05.042112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8562e8a2-db13-4ef9-a321-215144b2c76c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680058556" status: 202 len: 0 microversion: 2.1 time: 0.023583 Sep 22 17:14:05.042689 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 414/825] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 22 17:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680058556 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:14:05.694878 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-30273139-59ff-43c5-83f7-a11e1e571a63 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: .version_select at 0x7f51d93c6160>, body: {"keypair": {"name": "tempest-keypair-1554553393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvHqIkTIvjWlNdIGyL3tzT38sKfE1Mu+AtWmnIBcI68DruXi7E0ztoa4u5EQQVJzXcE15ZtoRs3tybreQRs62Nri12Mrkc0I9T7o7BqNGO15j0/PW6l2BIm3c9+j7Njvg=="}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:05.714868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-30273139-59ff-43c5-83f7-a11e1e571a63 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'key_pairs'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:14:05.718709 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-30273139-59ff-43c5-83f7-a11e1e571a63 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for user 5feea3b3b7e4401ea7db242cb60fdfcc and project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'key_pairs'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:14:05.742112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-30273139-59ff-43c5-83f7-a11e1e571a63 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051684 Sep 22 17:14:05.742696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 412/826] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:14:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:07.003767 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-705971876", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82eac7a2-877a-48c4-bcb2-cd10274854a5"}], "security_groups": [{"name": "tempest-securitygroup--1698143621"}], "key_name": "tempest-keypair-1554553393", "user_data": "}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:07.105987 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] validate_networks() for [('82eac7a2-877a-48c4-bcb2-cd10274854a5', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:14:07.559854 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:14:07.560271 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:14:07.560742 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:14:07.561145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:14:07.561551 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:14:07.571224 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:07.571633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:07.572058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:07.572771 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:07.573218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:07.573636 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:07.594177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:14:07.598342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for user 5feea3b3b7e4401ea7db242cb60fdfcc and project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:14:07.609189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:14:07.611555 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:14:07.662303 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1f57475c-29e6-4fe2-ade8-b175eb28197c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.663377 Sep 22 17:14:07.663070 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 415/827] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:14:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:14:07.675821 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f4cbdbae-a6dd-4eee-ae8c-0945cbc4517a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:07.676458 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f4cbdbae-a6dd-4eee-ae8c-0945cbc4517a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:07.733060 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f4cbdbae-a6dd-4eee-ae8c-0945cbc4517a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:07.740938 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f4cbdbae-a6dd-4eee-ae8c-0945cbc4517a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1241 microversion: 2.1 time: 0.070554 Sep 22 17:14:07.741615 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 413/828] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:07 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:08.764529 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:08.764529 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:08.770584 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:08.771109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:08.771546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:08.772234 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:08.772688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:08.773110 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:08.838681 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:08.846379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4289851e-6375-4db0-8a2c-3f481c7761e9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1293 microversion: 2.1 time: 0.086945 Sep 22 17:14:08.846977 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 416/829] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:08 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:09.870364 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:09.871231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:09.879159 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:09.879654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:09.880090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:09.880800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:09.881244 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:09.881664 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:09.953933 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:09.963527 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0ff694a4-3767-4e44-9a4e-0fb900413ff8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1299 microversion: 2.1 time: 0.097937 Sep 22 17:14:09.964112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 414/830] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:09 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:10.987410 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:10.988222 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:10.999732 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:11.000225 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:11.000669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:11.001382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:11.001836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:11.004073 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:11.441521 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:11.449422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-471e4b07-b924-4b3f-bb08-0bf550259bf2 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.466426 Sep 22 17:14:11.449996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 417/831] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:10 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:11.479010 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-c2aae612-78d1-47a6-9186-c6a2b76b173f req-4e9bc09e-9f68-4b09-8dba-01d87c62229b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebb556d-d6b7-4759-8a5d-e6e5eea385b6", "tag": "f9873726-23b4-4ccc-b694-5a56db8cb7db"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:11.492679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c2aae612-78d1-47a6-9186-c6a2b76b173f req-4e9bc09e-9f68-4b09-8dba-01d87c62229b service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:11.493466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c2aae612-78d1-47a6-9186-c6a2b76b173f req-4e9bc09e-9f68-4b09-8dba-01d87c62229b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:11.494058 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c2aae612-78d1-47a6-9186-c6a2b76b173f req-4e9bc09e-9f68-4b09-8dba-01d87c62229b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:11.507722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-c2aae612-78d1-47a6-9186-c6a2b76b173f req-4e9bc09e-9f68-4b09-8dba-01d87c62229b service nova] Creating event network-changed:f9873726-23b4-4ccc-b694-5a56db8cb7db for instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 on hv-cinder-83538 Sep 22 17:14:11.513976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-c2aae612-78d1-47a6-9186-c6a2b76b173f req-4e9bc09e-9f68-4b09-8dba-01d87c62229b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038272 Sep 22 17:14:11.515266 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 415/832] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:12.471927 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:12.472529 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:12.479120 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:12.479613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:12.480049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:12.480750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:12.481203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:12.481658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:12.618526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:12.626515 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-da0fb64c-5f1b-4156-a0f3-c0256983211d tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.158421 Sep 22 17:14:12.627192 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 418/833] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:12 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:13.652087 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:13.652774 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:13.654737 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:13.661657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:13.662144 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:13.662580 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:13.663313 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:13.663773 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:13.664192 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:13.822780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:13.831988 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-eec5598a-7a56-40a1-b3c1-47b5ca7d1a8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.185867 Sep 22 17:14:13.832557 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 416/834] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:13 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:14.854574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:14.855221 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:14.861335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:14.862325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:14.862755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:14.863464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:14.863910 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:14.864327 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:14.993463 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:15.001047 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-40b5b12d-7027-4c9b-a15b-6efcd8b3c7fc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.150350 Sep 22 17:14:15.001605 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 419/835] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:14 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:16.023475 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:16.024023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:16.030930 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:16.031458 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:16.031981 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:16.032592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:16.033048 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:16.033477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:16.168080 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:16.177770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e83847a7-5bcd-4e53-9309-d98834f7b4f3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.158677 Sep 22 17:14:16.178364 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 417/836] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:16 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:16.896386 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:16.897038 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:16.903769 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:16.904255 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:16.904693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:16.905403 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:16.905853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:16.906277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:16.930298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lazy-loading 'flavor' on Instance uuid 60e671ca-5873-4190-9048-a875393d1055 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:14:17.006703 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-08251673-ada6-478c-b120-b629c5235608 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "POST /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055/action" status: 202 len: 0 microversion: 2.1 time: 0.114261 Sep 22 17:14:17.007342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 420/837] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:14:16 2022] POST /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:14:17.015942 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:17.016462 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:17.023182 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:17.023691 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:17.024290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:17.024820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:17.025274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:17.025713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:17.031877 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:17.197036 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:17.202734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:17.203474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:17.205029 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e6e23f85-c527-4b98-9ccb-34c515d2919d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.192981 Sep 22 17:14:17.205609 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 418/838] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:17 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:17.211328 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:17.211828 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:17.212267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:17.212984 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:17.213440 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:17.213867 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:17.363638 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:17.371587 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-02a753e0-57df-4444-bfc3-2c6655ef40b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.174026 Sep 22 17:14:17.372177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 421/839] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:17 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:14:18.229643 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:18.230473 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:18.232798 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:18.239617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:18.240117 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:18.240572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:18.241268 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:18.241721 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:18.242150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:18.385728 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:18.393767 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9ed43abb-0f65-41dc-afa3-5bf042aad408 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.167868 Sep 22 17:14:18.394886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 419/840] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:18 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:18.402156 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:18.403130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:18.405950 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:18.406920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:18.417651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:18.418155 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:18.418597 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:18.419360 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:18.419818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:18.420243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:18.562820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:18.570604 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-208e2511-9a40-4977-8570-0e494cfadfad tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.174825 Sep 22 17:14:18.571204 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 422/841] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:18 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:19.419392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:19.420235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:19.427616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:19.428113 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:19.430630 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:19.431419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:19.431887 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:19.432314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:19.577079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:19.592183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4ec3b208-c6ce-430d-9c11-c3381bfb28f9 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.176285 Sep 22 17:14:19.593274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 420/842] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:19 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:19.603065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:19.603065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:19.610663 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:19.611492 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:19.612013 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:19.612842 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:19.613421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:19.614030 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:19.649531 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-fff37183-b51e-426c-9fc9-aa26cbc606fa req-cd9e4fe6-8e6a-4384-a50e-930364fccf9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebb556d-d6b7-4759-8a5d-e6e5eea385b6", "name": "network-vif-plugged", "status": "completed", "tag": "f9873726-23b4-4ccc-b694-5a56db8cb7db"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:19.664889 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-fff37183-b51e-426c-9fc9-aa26cbc606fa req-cd9e4fe6-8e6a-4384-a50e-930364fccf9d service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:19.665370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-fff37183-b51e-426c-9fc9-aa26cbc606fa req-cd9e4fe6-8e6a-4384-a50e-930364fccf9d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:19.665793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-fff37183-b51e-426c-9fc9-aa26cbc606fa req-cd9e4fe6-8e6a-4384-a50e-930364fccf9d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:19.688738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-fff37183-b51e-426c-9fc9-aa26cbc606fa req-cd9e4fe6-8e6a-4384-a50e-930364fccf9d service nova] Creating event network-vif-plugged:f9873726-23b4-4ccc-b694-5a56db8cb7db for instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 on hv-cinder-83538 Sep 22 17:14:19.694455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-fff37183-b51e-426c-9fc9-aa26cbc606fa req-cd9e4fe6-8e6a-4384-a50e-930364fccf9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054088 Sep 22 17:14:19.695757 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 421/843] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:19.754451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:19.764102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ab3a449e-c8cb-41b4-9fe9-d7d6f7871e8c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.173551 Sep 22 17:14:19.764862 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 423/844] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:19 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:20.747871 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:20.749754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:20.756418 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:20.756915 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:20.757349 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:20.758072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:20.758530 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:20.758978 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:20.788862 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:20.789480 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:20.795965 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:20.796447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:20.796871 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:20.797558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:20.798012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:20.798680 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:20.958243 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:20.967145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9b4fb64b-875c-4307-ab89-bcaf42e0d406 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.324986 Sep 22 17:14:20.967746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 422/845] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:20 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:20.989117 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:20.997122 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cdecf4be-9478-47fa-9712-4ae60a64fe5a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.212601 Sep 22 17:14:20.997710 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 424/846] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:20 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:14:21.991350 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:21.992074 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:21.999047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:21.999547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:21.999988 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:22.000814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:22.001279 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:22.001699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:22.021402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:22.022065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:22.029142 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:22.029638 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:22.030061 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:22.030795 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:22.031271 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:22.031711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:22.203741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:22.212172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cd073271-4870-4b0b-ba83-4ea5fb4290c7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.225417 Sep 22 17:14:22.212953 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 423/847] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:21 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:22.232432 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:22.240290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fbc05131-a4fb-4dda-bf84-aa1198c5c7d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1367 microversion: 2.1 time: 0.223632 Sep 22 17:14:22.240858 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 425/848] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:22 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:14:23.236092 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:23.236708 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:23.243964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:23.244456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:23.244887 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:23.245580 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:23.246035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:23.246452 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:23.264938 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:23.265532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:23.272502 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:23.272995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:23.273434 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:23.274140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:23.274597 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:23.275106 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:23.467436 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:23.476592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-de134b96-e117-4d0a-b60b-8562376b954f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.244051 Sep 22 17:14:23.477189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 424/849] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:23 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:23.479363 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:23.483075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:23.489379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1037dd01-2e82-4193-bd9b-4159d6954a4c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1557 microversion: 2.1 time: 0.228670 Sep 22 17:14:23.489896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 426/850] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:23 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:14:23.512404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4a62d2f0-7dff-4a8b-9456-c38e65a9c9fb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:23.512905 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4a62d2f0-7dff-4a8b-9456-c38e65a9c9fb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:23.519504 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a62d2f0-7dff-4a8b-9456-c38e65a9c9fb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:23.519995 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a62d2f0-7dff-4a8b-9456-c38e65a9c9fb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:23.520432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a62d2f0-7dff-4a8b-9456-c38e65a9c9fb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:23.521135 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a62d2f0-7dff-4a8b-9456-c38e65a9c9fb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:23.521588 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a62d2f0-7dff-4a8b-9456-c38e65a9c9fb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:23.522016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a62d2f0-7dff-4a8b-9456-c38e65a9c9fb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:23.604229 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4a62d2f0-7dff-4a8b-9456-c38e65a9c9fb tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095816 Sep 22 17:14:23.604836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 425/851] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 22 17:14:23 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:24.501241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:24.501861 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:24.511205 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:24.511743 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:24.512181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:24.512890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:24.513362 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:24.513787 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:24.597106 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-b8635d13-c0a1-40e9-9a5e-a979b2cb338a req-d5df6e69-d4cb-41f7-a74b-af4e4c3e453f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebb556d-d6b7-4759-8a5d-e6e5eea385b6", "tag": "f9873726-23b4-4ccc-b694-5a56db8cb7db"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:24.606909 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-b8635d13-c0a1-40e9-9a5e-a979b2cb338a req-d5df6e69-d4cb-41f7-a74b-af4e4c3e453f service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:24.607430 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-b8635d13-c0a1-40e9-9a5e-a979b2cb338a req-d5df6e69-d4cb-41f7-a74b-af4e4c3e453f service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:24.607853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-b8635d13-c0a1-40e9-9a5e-a979b2cb338a req-d5df6e69-d4cb-41f7-a74b-af4e4c3e453f service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:24.621249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-b8635d13-c0a1-40e9-9a5e-a979b2cb338a req-d5df6e69-d4cb-41f7-a74b-af4e4c3e453f service nova] Creating event network-changed:f9873726-23b4-4ccc-b694-5a56db8cb7db for instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 on hv-cinder-83538 Sep 22 17:14:24.626614 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-b8635d13-c0a1-40e9-9a5e-a979b2cb338a req-d5df6e69-d4cb-41f7-a74b-af4e4c3e453f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033767 Sep 22 17:14:24.627498 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 426/852] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:14:24.667860 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:24.678027 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e3d15afe-4cd6-4cd3-9d12-2cd3a0e37960 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.180592 Sep 22 17:14:24.678614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 427/853] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:24 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:25.703503 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:25.704213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:25.711769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:25.712267 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:25.712973 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:25.713707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:25.714160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:25.714591 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:25.865114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:25.873029 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d3889c77-49f1-41f9-a8fb-51e381bf2290 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.174922 Sep 22 17:14:25.873680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 427/854] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:25 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:26.901263 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:26.902317 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:26.905358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:26.911043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:26.911541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:26.911980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:26.912687 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:26.913145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:26.913573 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:27.054774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:27.063222 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4cc37f88-d778-479b-abab-d75bd0ade571 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.169602 Sep 22 17:14:27.063793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 428/855] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:26 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:28.087016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:28.087628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:28.094310 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:28.094798 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:28.095265 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:28.095965 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:28.096419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:28.096876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:28.233002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:28.241983 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9bcea736-9fa4-4633-8f43-8821ead83478 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.159139 Sep 22 17:14:28.242578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 428/856] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:28 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:29.271660 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:29.272737 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:29.293664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:29.294153 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:29.294594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:29.295338 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:29.295800 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:29.296225 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:29.451555 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:29.461075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d1c6ff77-d0ec-4f12-bef5-7af9399b48b4 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.197808 Sep 22 17:14:29.461676 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 429/857] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:29 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:30.485657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:30.486330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:30.493579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:30.494069 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:30.494506 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:30.495279 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:30.495746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:30.496177 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:30.674858 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:30.685559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8e663580-5758-43ed-8d14-c043c517aa7b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1569 microversion: 2.1 time: 0.203779 Sep 22 17:14:30.686172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 429/858] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:30 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:14:30.715688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:30.716815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:30.728862 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:30.730152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:30.730923 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:30.732122 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:30.732660 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:30.733488 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:30.777597 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120805) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 17:14:30.860835 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bd8dba9e-8acd-4fb3-894f-8cd1394c2ef7 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "POST /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055/action" status: 202 len: 0 microversion: 2.1 time: 0.152912 Sep 22 17:14:30.861464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 430/859] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:14:30 2022] POST /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:14:30.873113 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:30.873771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:30.880793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:30.881288 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:30.881725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:30.882442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:30.882898 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:30.883355 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:31.043608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:31.055424 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4a9386b7-c446-41e0-9712-36a3ab89d552 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1517 microversion: 2.1 time: 0.185803 Sep 22 17:14:31.056022 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 430/860] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:30 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:31.163996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fef3d8e7-8289-46fc-9cb8-aea05a07559b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:31.164541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fef3d8e7-8289-46fc-9cb8-aea05a07559b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:31.175571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fef3d8e7-8289-46fc-9cb8-aea05a07559b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:31.176454 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fef3d8e7-8289-46fc-9cb8-aea05a07559b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:31.177205 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fef3d8e7-8289-46fc-9cb8-aea05a07559b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:31.178481 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fef3d8e7-8289-46fc-9cb8-aea05a07559b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:31.179530 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fef3d8e7-8289-46fc-9cb8-aea05a07559b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:31.180300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fef3d8e7-8289-46fc-9cb8-aea05a07559b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:31.222323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fef3d8e7-8289-46fc-9cb8-aea05a07559b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments/774e5840-372e-48f6-84fd-c3cf568ba427" status: 200 len: 194 microversion: 2.20 time: 0.064422 Sep 22 17:14:31.222934 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 431/861] 10.222.0.16 () {60 vars in 1454 bytes} [Thu Sep 22 17:14:31 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments/774e5840-372e-48f6-84fd-c3cf568ba427 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:14:31.315055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:31.316191 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:31.322600 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:31.324730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:31.324730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:31.324730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:31.324730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:31.325575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:31.408557 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lazy-loading 'services' on Instance uuid eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:14:31.497240 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bb5856d3-8163-4966-9523-c73ec27ca3b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments/774e5840-372e-48f6-84fd-c3cf568ba427" status: 202 len: 0 microversion: 2.20 time: 0.185063 Sep 22 17:14:31.498333 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 431/862] 10.222.0.16 () {60 vars in 1457 bytes} [Thu Sep 22 17:14:31 2022] DELETE /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments/774e5840-372e-48f6-84fd-c3cf568ba427 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:14:31.512952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aaefcec4-fa54-4649-a51a-3623682bad50 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:31.517267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aaefcec4-fa54-4649-a51a-3623682bad50 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:31.529764 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaefcec4-fa54-4649-a51a-3623682bad50 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:31.530928 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaefcec4-fa54-4649-a51a-3623682bad50 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:31.531847 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaefcec4-fa54-4649-a51a-3623682bad50 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:31.533113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaefcec4-fa54-4649-a51a-3623682bad50 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:31.533968 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaefcec4-fa54-4649-a51a-3623682bad50 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:31.534619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aaefcec4-fa54-4649-a51a-3623682bad50 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:31.569548 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aaefcec4-fa54-4649-a51a-3623682bad50 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065198 Sep 22 17:14:31.570402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 432/863] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 22 17:14:31 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:14:32.080026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:32.080736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:32.088713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:32.089318 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:32.089858 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:32.090712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:32.091316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:32.091868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:32.440054 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:32.448731 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-87c6847f-48f0-438f-9a5a-d4818acd6790 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1517 microversion: 2.1 time: 0.372947 Sep 22 17:14:32.449310 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 432/864] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:32 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1517 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:32.584469 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4fad59ba-3eff-48a9-80d5-8912ea43237a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:32.587963 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4fad59ba-3eff-48a9-80d5-8912ea43237a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:32.596250 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4fad59ba-3eff-48a9-80d5-8912ea43237a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:32.596816 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4fad59ba-3eff-48a9-80d5-8912ea43237a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:32.597313 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4fad59ba-3eff-48a9-80d5-8912ea43237a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:32.598177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4fad59ba-3eff-48a9-80d5-8912ea43237a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:32.598770 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4fad59ba-3eff-48a9-80d5-8912ea43237a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:32.599295 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4fad59ba-3eff-48a9-80d5-8912ea43237a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:32.634695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4fad59ba-3eff-48a9-80d5-8912ea43237a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056446 Sep 22 17:14:32.635321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 433/865] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 22 17:14:32 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 17:14:33.476947 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:33.478066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:33.486771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:33.487465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:33.488099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:33.489477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:33.490304 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:33.491259 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:33.585230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-83663350-000d-46c6-a0c0-8f6e3c60c945 req-2d06582c-9b13-488f-a19d-e52d8212d626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e671ca-5873-4190-9048-a875393d1055", "name": "network-vif-unplugged", "status": "completed", "tag": "bfa945c1-4510-4653-9180-db1133adbc18"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:33.602191 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-83663350-000d-46c6-a0c0-8f6e3c60c945 req-2d06582c-9b13-488f-a19d-e52d8212d626 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:33.602663 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-83663350-000d-46c6-a0c0-8f6e3c60c945 req-2d06582c-9b13-488f-a19d-e52d8212d626 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:33.603047 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-83663350-000d-46c6-a0c0-8f6e3c60c945 req-2d06582c-9b13-488f-a19d-e52d8212d626 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:33.616808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.compute.server_external_events [req-83663350-000d-46c6-a0c0-8f6e3c60c945 req-2d06582c-9b13-488f-a19d-e52d8212d626 service nova] Unable to find a host for instance 60e671ca-5873-4190-9048-a875393d1055. Dropping event network-vif-unplugged {{(pid=120805) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 22 17:14:33.617599 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-83663350-000d-46c6-a0c0-8f6e3c60c945 req-2d06582c-9b13-488f-a19d-e52d8212d626 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040706 Sep 22 17:14:33.618712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 434/866] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 22 17:14:33.660262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e924cb83-92ef-4132-9412-d68454e49938 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:33.662768 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e924cb83-92ef-4132-9412-d68454e49938 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:33.671797 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e924cb83-92ef-4132-9412-d68454e49938 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:33.672585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e924cb83-92ef-4132-9412-d68454e49938 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:33.673464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e924cb83-92ef-4132-9412-d68454e49938 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:33.674544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e924cb83-92ef-4132-9412-d68454e49938 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:33.675370 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e924cb83-92ef-4132-9412-d68454e49938 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:33.681078 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e924cb83-92ef-4132-9412-d68454e49938 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:33.725210 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e924cb83-92ef-4132-9412-d68454e49938 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.068881 Sep 22 17:14:33.726095 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 435/867] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 22 17:14:33 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:33.738146 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:33.746521 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-269a3a74-01b2-450a-986e-98edae32889d tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1519 microversion: 2.1 time: 0.275810 Sep 22 17:14:33.747146 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 433/868] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:33 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:33.818503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:33.819375 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:33.826126 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:33.826617 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:33.827303 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:33.828033 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:33.828487 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:33.829147 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:33.863814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:14:33.975010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8e839b18-d14f-49b1-98e1-cee2b7bb52f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 204 len: 0 microversion: 2.20 time: 0.160246 Sep 22 17:14:33.976272 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 436/869] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 22 17:14:33 2022] DELETE /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 17:14:33.985826 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:33.987419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:33.995801 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:33.996345 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:33.996733 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:33.997441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:33.997985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:33.998415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:34.132805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:34.141131 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:34.142561 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:34.143758 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-26ce6346-3dfa-49a2-932c-4a9c42b818aa tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.162420 Sep 22 17:14:34.144315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 434/870] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:33 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:34.773519 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:34.774240 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:34.784297 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:34.784837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:34.785276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:34.785983 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:34.786437 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:34.786860 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:34.934688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:34.943695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f59dbbbf-aacd-4c59-b025-840ebbd90a49 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.174897 Sep 22 17:14:34.944395 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 437/871] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:34 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:35.169195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:35.169735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:35.177261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:35.177745 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:35.178188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:35.178890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:35.179382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:35.179806 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:35.325557 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:35.328274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:35.336247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:35.337679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:35.338897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ace40396-b71f-4310-bd25-1cf82e28ce52 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.173781 Sep 22 17:14:35.339482 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 435/872] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:35 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:35.968622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:35.969242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:35.976071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:35.976567 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:35.977004 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:35.980578 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:35.981043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:35.981475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:36.241110 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:36.255387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a2cf252b-dda9-4c45-a1ca-0dfdf2e0bf75 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.290821 Sep 22 17:14:36.256503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 438/873] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:35 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:36.369111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:36.369738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:36.379161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:36.379662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:36.380102 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:36.380856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:36.381461 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:36.381900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:36.970204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:36.981479 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:36.983036 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:36.984280 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e2bfbfe9-cb1b-4360-9e37-41db805ef0eb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1722 microversion: 2.20 time: 0.620263 Sep 22 17:14:36.984863 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 436/874] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:36 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1722 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:37.291223 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:37.291950 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:37.299879 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:37.300378 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:37.300814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:37.301733 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:37.302199 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:37.302779 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:37.556456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:37.568218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2ec8be58-3f83-4576-9fc5-8171cf236887 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.280865 Sep 22 17:14:37.576638 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 439/875] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:37 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:37.841787 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-60fc8b8c-2132-4cb6-94b2-7d8d272584c0 req-2fc26513-b11c-4626-97d0-32515122120b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2", "name": "network-vif-deleted", "tag": "9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:37.852400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-60fc8b8c-2132-4cb6-94b2-7d8d272584c0 req-2fc26513-b11c-4626-97d0-32515122120b service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:37.852880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-60fc8b8c-2132-4cb6-94b2-7d8d272584c0 req-2fc26513-b11c-4626-97d0-32515122120b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:37.853325 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-60fc8b8c-2132-4cb6-94b2-7d8d272584c0 req-2fc26513-b11c-4626-97d0-32515122120b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:37.866052 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-60fc8b8c-2132-4cb6-94b2-7d8d272584c0 req-2fc26513-b11c-4626-97d0-32515122120b service nova] Creating event network-vif-deleted:9d17cd6f-7ad0-400c-a4f4-da7cf6bc52ea for instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 on hv-cinder-83538 Sep 22 17:14:37.871302 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-60fc8b8c-2132-4cb6-94b2-7d8d272584c0 req-2fc26513-b11c-4626-97d0-32515122120b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033380 Sep 22 17:14:37.871915 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 437/876] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:14:38.011349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:38.012506 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:38.019094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:38.019981 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:38.020601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:38.021531 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:38.021995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:38.022531 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:38.108059 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:38.117520 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:38.118678 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:38.119928 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2e4d43b3-a57c-4d7d-9abc-47d462d99571 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1654 microversion: 2.20 time: 0.113817 Sep 22 17:14:38.120855 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 440/877] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:38 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1654 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:38.595252 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:38.595866 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:38.604782 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:38.605199 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:38.605816 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:38.606791 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:38.607870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:38.608455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:38.756804 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:38.773727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4f220245-dd48-435a-8000-9518171ce204 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.182986 Sep 22 17:14:38.774390 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 438/878] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:38 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:39.148022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:39.148593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:39.155184 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:39.155669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:39.156105 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:39.156793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:39.157249 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:39.157679 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:39.175762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:39.192685 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:39.193161 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:39.193600 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:39.194045 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lazy-loading 'fault' on Instance uuid eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:14:39.237797 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:39.247058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:39.248516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:39.249719 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-185457e2-db25-4b14-bbc7-3a25ebf6cd7b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 200 len: 1371 microversion: 2.20 time: 0.106393 Sep 22 17:14:39.250423 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 441/879] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:39 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:39.797860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:39.798747 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:39.805642 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:39.806122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:39.806551 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:39.807257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:39.807703 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:39.808117 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:39.942524 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:39.950251 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-11572036-4b9c-41e5-a346-4edc93909e2f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.156323 Sep 22 17:14:39.950812 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 439/880] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:39 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:40.277673 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:40.278394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:40.285780 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:40.286267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:40.286702 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:40.287421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:40.287877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:40.288301 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:40.301713 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] HTTP exception thrown: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Request method failure captured: Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 HTTP/1.1 Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZQm7GrAd2Y7_AhTeJO9i6-0Pgkl8T-j1lymY4zz2ebN1uo5n1sJ-EOH-rAZHT2polLoEgi9VDtySpfEic7cBSgaw4zGZNVlN8MGIJ9pymiYHDp3PMJoW8ZFno_C_OWTjnBDbR4lDiPh5V_EbJfxz4fZQp9Q6n-7BBGUoTot5Sw2fk Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:14:40.303342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: b34e9318826c49ed891dde1f7782898b Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:14:40.305096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2'} Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:14:40.306146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:14:40.307669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:14:40.308971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Returning 404 to user: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:14:40.308971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bfcec8fa-b9a9-4b42-9b6e-4c3167132111 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 404 len: 111 microversion: 2.20 time: 0.031297 Sep 22 17:14:40.308971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 442/881] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:40 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:14:40.313601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bce4c06e-964e-4b1d-8ee3-3fc9f051ebe7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '.version_select at 0x7f51d9239670>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:40.334050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bce4c06e-964e-4b1d-8ee3-3fc9f051ebe7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738208346" status: 204 len: 0 microversion: 2.20 time: 0.024188 Sep 22 17:14:40.334645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 440/882] 10.222.0.16 () {60 vars in 1259 bytes} [Thu Sep 22 17:14:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738208346 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 17:14:40.973728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:40.974649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:40.981071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:40.981552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:40.981992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:40.982700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:40.983217 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:40.983634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:40.994235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-728a2125-be82-41b5-8ae6-f9a93b06a7b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'create', calling method: .version_select at 0x7f51d937bca0>, body: {"keypair": {"name": "tempest-keypair-1970848712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHcdQ2vN8ASS3dXlGhiryUU5lyE6VTs0XDQ41BYc7kPNYMzl/91BZYRkOvKEyVdIiVscn/yw8xfP+mPG81dZW3lJPxDFYqQU1Iz6N8D0kEKcYZSdiqKiP7q6oG6RdZwQ=="}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:41.012201 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-728a2125-be82-41b5-8ae6-f9a93b06a7b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Getting quotas for project 45847b1fd67c4caaa03a36895cd2263a. Resources: {'key_pairs'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:14:41.016595 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-728a2125-be82-41b5-8ae6-f9a93b06a7b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Getting quotas for user b34e9318826c49ed891dde1f7782898b and project 45847b1fd67c4caaa03a36895cd2263a. Resources: {'key_pairs'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:14:41.041754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-728a2125-be82-41b5-8ae6-f9a93b06a7b7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051196 Sep 22 17:14:41.042838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 441/883] 10.222.0.16 () {62 vars in 1200 bytes} [Thu Sep 22 17:14:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 22 17:14:41.149991 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:41.159370 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-64dc61e7-9e5d-46d5-9c81-ca5376844f62 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.189152 Sep 22 17:14:41.159965 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 443/884] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:40 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:42.188337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:42.188337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:42.195723 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:42.196240 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:42.196738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:42.197447 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:42.197895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:42.198312 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:42.341304 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:42.353033 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-08cb6b4b-7d73-44e6-920b-970a9443646c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.172962 Sep 22 17:14:42.353865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 442/885] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:42 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:42.486157 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-267533118", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb742a8a-ec14-42fa-b5c3-8fe1992e342c"}], "security_groups": [{"name": "tempest-securitygroup--1392365221"}], "key_name": "tempest-keypair-1970848712", "user_data": "}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:42.589540 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] validate_networks() for [('fb742a8a-ec14-42fa-b5c3-8fe1992e342c', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:14:42.962651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:14:42.963118 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:14:42.963599 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:14:42.964012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:14:42.964431 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:14:42.973839 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:42.974322 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:42.974759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:42.975535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:42.975979 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:42.976404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:42.994249 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Getting quotas for project 45847b1fd67c4caaa03a36895cd2263a. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:14:42.998227 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Getting quotas for user b34e9318826c49ed891dde1f7782898b and project 45847b1fd67c4caaa03a36895cd2263a. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:14:43.009518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:14:43.011901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:14:43.058927 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-83c75bb3-bec3-4349-8011-4b64cdc9c033 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.577051 Sep 22 17:14:43.059534 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 444/886] 10.222.0.16 () {62 vars in 1188 bytes} [Thu Sep 22 17:14:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 22 17:14:43.070761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f13ef1eb-2726-4b16-b3a7-b5da5c95a588 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:43.071412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f13ef1eb-2726-4b16-b3a7-b5da5c95a588 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:43.125110 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f13ef1eb-2726-4b16-b3a7-b5da5c95a588 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:43.132746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f13ef1eb-2726-4b16-b3a7-b5da5c95a588 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:43.134206 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f13ef1eb-2726-4b16-b3a7-b5da5c95a588 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:43.135380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f13ef1eb-2726-4b16-b3a7-b5da5c95a588 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1281 microversion: 2.20 time: 0.068460 Sep 22 17:14:43.135975 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 443/887] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:43 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:43.377865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:43.378677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:43.387718 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:43.388292 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:43.388735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:43.389474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:43.390051 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:43.390371 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:43.541555 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:43.552321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7bbd698c-b787-4541-8048-f2d8dfad628f tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.178661 Sep 22 17:14:43.553064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 445/888] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:43 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:44.160952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:44.161567 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:44.164014 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:44.170121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:44.170609 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:44.171070 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:44.171772 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:44.172229 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:44.172659 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:44.235711 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:44.244348 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:44.245779 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:44.246870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e81c5d88-23cb-435f-8c1d-b3898337f99d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1333 microversion: 2.20 time: 0.090404 Sep 22 17:14:44.247450 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 444/889] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:44 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:44.592924 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:44.593519 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:44.600103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:44.600916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:44.601355 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:44.602031 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:44.602478 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:44.602895 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:44.733485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:44.741433 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-697c9538-6ce6-4b33-8902-dc8d4c5330eb tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.152505 Sep 22 17:14:44.742005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 446/890] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:44 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:45.272072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:45.272689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:45.279685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:45.280247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:45.280992 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:45.281585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:45.282256 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:45.282690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:45.347375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:45.355500 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:45.356958 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:45.358118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-00ecaed6-d411-41f5-846c-71d00fb4dcc8 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1333 microversion: 2.20 time: 0.090521 Sep 22 17:14:45.358603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 445/891] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:45 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:45.764911 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:45.766144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:45.773822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:45.774561 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:45.775024 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:45.775761 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:45.776403 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:45.776837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:45.988294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:45.996135 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-eea61a9c-d413-44d7-a0ed-a57bd1d20203 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.235719 Sep 22 17:14:45.996692 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 447/892] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:45 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:46.382900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:46.383536 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:46.390659 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:46.391184 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:46.391626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:46.392347 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:46.392846 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:46.393781 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:46.465872 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:46.474274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:46.475769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:46.476888 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bae6a95f-2faf-4581-ad5c-be2ffe6c3c18 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1339 microversion: 2.20 time: 0.098043 Sep 22 17:14:46.477457 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 446/893] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:46 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:47.018790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:47.019818 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:47.026529 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:47.027059 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:47.027502 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:47.028230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:47.028687 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:47.029113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:47.378084 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:47.387322 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-38d8c1f8-a074-4a10-b3f9-687d03adfe8e tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.372380 Sep 22 17:14:47.402974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 448/894] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:47 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:47.503500 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:47.504118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:47.510880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:47.511545 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:47.511945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:47.513040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:47.514155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:47.514601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:47.741843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:47.755592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:47.757347 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:47.763395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d67a4e32-9b2e-4005-ba21-384bfdf5bc36 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1407 microversion: 2.20 time: 0.259789 Sep 22 17:14:47.779535 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 447/895] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:47 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:47.827537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-f4ae4c76-d555-4d98-81bd-c9b7e347abe0 req-17ed24a0-c052-4007-9a73-0b6662b4f81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3946f917-8585-453c-9eff-81ab4ba3b860", "tag": "53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:47.840087 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-f4ae4c76-d555-4d98-81bd-c9b7e347abe0 req-17ed24a0-c052-4007-9a73-0b6662b4f81b service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:47.840709 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-f4ae4c76-d555-4d98-81bd-c9b7e347abe0 req-17ed24a0-c052-4007-9a73-0b6662b4f81b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:47.841150 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-f4ae4c76-d555-4d98-81bd-c9b7e347abe0 req-17ed24a0-c052-4007-9a73-0b6662b4f81b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:47.855072 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-f4ae4c76-d555-4d98-81bd-c9b7e347abe0 req-17ed24a0-c052-4007-9a73-0b6662b4f81b service nova] Creating event network-changed:53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7 for instance 3946f917-8585-453c-9eff-81ab4ba3b860 on hv-cinder-83538 Sep 22 17:14:47.860583 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-f4ae4c76-d555-4d98-81bd-c9b7e347abe0 req-17ed24a0-c052-4007-9a73-0b6662b4f81b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036563 Sep 22 17:14:47.861195 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 449/896] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:48.411916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:48.412530 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:48.418493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:48.419002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:48.419443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:48.420140 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:48.420590 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:48.421013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:48.566276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:48.576422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c8952886-ca5f-448c-a709-39f46f976eba tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.168323 Sep 22 17:14:48.577208 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 448/897] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:48 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:48.790643 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:48.791364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:48.798539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:48.799734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:48.800176 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:48.800887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:48.801341 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:48.801766 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:48.947959 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:48.956387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:48.957845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:48.958993 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-43bfc4be-e2a1-4a2f-9c29-9171b1fd26cc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1407 microversion: 2.20 time: 0.172650 Sep 22 17:14:48.959563 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 450/898] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:48 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:49.600634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:49.601253 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:49.608109 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:49.608600 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:49.609040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:49.609832 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:49.610380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:49.610851 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:49.765768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:49.774087 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b7557487-0ee8-4b74-adf3-a9cd92e9556b tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.177305 Sep 22 17:14:49.774675 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 449/899] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:49 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:49.976005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-6079b8b1-a81b-4691-a878-0d200bca2dfc req-21b87f38-9e5a-4057-acbe-f6d436203bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e671ca-5873-4190-9048-a875393d1055", "name": "network-vif-plugged", "status": "completed", "tag": "bfa945c1-4510-4653-9180-db1133adbc18"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:49.985522 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:49.987082 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:49.987506 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6079b8b1-a81b-4691-a878-0d200bca2dfc req-21b87f38-9e5a-4057-acbe-f6d436203bb5 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:49.988000 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6079b8b1-a81b-4691-a878-0d200bca2dfc req-21b87f38-9e5a-4057-acbe-f6d436203bb5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:49.988521 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-6079b8b1-a81b-4691-a878-0d200bca2dfc req-21b87f38-9e5a-4057-acbe-f6d436203bb5 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:49.995271 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:49.996016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:49.996371 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:49.997096 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:49.997551 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:49.997974 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:50.004482 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-6079b8b1-a81b-4691-a878-0d200bca2dfc req-21b87f38-9e5a-4057-acbe-f6d436203bb5 service nova] Creating event network-vif-plugged:bfa945c1-4510-4653-9180-db1133adbc18 for instance 60e671ca-5873-4190-9048-a875393d1055 on hv-cinder-83538 Sep 22 17:14:50.008966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-6079b8b1-a81b-4691-a878-0d200bca2dfc req-21b87f38-9e5a-4057-acbe-f6d436203bb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036628 Sep 22 17:14:50.009929 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 451/900] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:50.137823 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:50.146629 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:50.148122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:50.149263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bbbac24d-ef5a-467c-949e-fea17fab6e0e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1407 microversion: 2.20 time: 0.167988 Sep 22 17:14:50.149827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 450/901] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:49 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:14:50.798573 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:50.799447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:50.805646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:50.806129 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:50.806569 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:50.807290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:50.807738 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:50.808160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:50.958296 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:50.966977 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2aeb6c8a-933f-4d6e-99e5-4d7eeed71001 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.172852 Sep 22 17:14:50.967579 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 452/902] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:50 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:51.174435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:51.175073 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:51.181754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:51.182241 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:51.182680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:51.183408 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:51.183862 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:51.184289 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:51.472056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:51.480607 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:51.482183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:51.483339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-15792838-873f-4381-bbcd-97d96c518819 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1407 microversion: 2.20 time: 0.313103 Sep 22 17:14:51.483921 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 451/903] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:51 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:51.991681 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:51.992266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:51.999942 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:52.001127 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:52.001269 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:52.002035 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:52.002650 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:52.003110 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:52.191188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:52.199345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1c7ad69d-7c80-485b-bb87-448e058b3255 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.213252 Sep 22 17:14:52.199922 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 453/904] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:51 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:52.509482 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:52.510078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:52.518305 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:52.518792 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:52.519257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:52.519957 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:52.520415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:52.520843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:52.668827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:52.679491 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:52.680961 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:52.682108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b06b9f17-4e89-438c-b349-b6a058649d2c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1407 microversion: 2.20 time: 0.176673 Sep 22 17:14:52.682653 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 452/905] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:52 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:53.224154 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:53.224755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:53.226731 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:53.227929 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:53.233792 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:53.234276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:53.234701 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:53.235418 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:53.235868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:53.236347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:53.378819 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:53.387727 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c35a9731-c068-491f-82c3-b13997a73209 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1575 microversion: 2.1 time: 0.167942 Sep 22 17:14:53.388302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 454/906] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:53 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:53.710710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:53.711409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:53.713434 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:53.719608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:53.720100 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:53.720538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:53.721834 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:53.722287 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:53.722711 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:53.863164 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:53.872271 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:53.873883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:53.875583 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7d48f5e4-7603-4624-857f-e3656ba49875 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1407 microversion: 2.20 time: 0.168465 Sep 22 17:14:53.875901 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 453/907] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:53 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:54.259728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-5240cdb7-0a33-41e4-9b90-9ecb557bbcaf req-dbb55604-218b-43e2-8ca7-b455ed59df20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3946f917-8585-453c-9eff-81ab4ba3b860", "name": "network-vif-plugged", "status": "completed", "tag": "53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:54.271712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-5240cdb7-0a33-41e4-9b90-9ecb557bbcaf req-dbb55604-218b-43e2-8ca7-b455ed59df20 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:54.272194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-5240cdb7-0a33-41e4-9b90-9ecb557bbcaf req-dbb55604-218b-43e2-8ca7-b455ed59df20 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:54.273155 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-5240cdb7-0a33-41e4-9b90-9ecb557bbcaf req-dbb55604-218b-43e2-8ca7-b455ed59df20 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:54.291290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-5240cdb7-0a33-41e4-9b90-9ecb557bbcaf req-dbb55604-218b-43e2-8ca7-b455ed59df20 service nova] Creating event network-vif-plugged:53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7 for instance 3946f917-8585-453c-9eff-81ab4ba3b860 on hv-cinder-83538 Sep 22 17:14:54.299898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-5240cdb7-0a33-41e4-9b90-9ecb557bbcaf req-dbb55604-218b-43e2-8ca7-b455ed59df20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043859 Sep 22 17:14:54.300553 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 455/908] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:14:54.409952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:54.410691 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:54.416936 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:54.417492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:54.418002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:54.418760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:54.419301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:54.419811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:54.612562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:54.621041 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2ba1e9e1-996d-499e-989c-0c0d31d30d6c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1562 microversion: 2.1 time: 0.214803 Sep 22 17:14:54.621707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 454/909] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:54 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1562 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:14:54.902198 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:54.902814 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:54.909580 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:54.910065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:54.910496 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:54.911225 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:54.911684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:54.912107 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:55.044158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:55.052967 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:55.054405 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:55.055624 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c75ca1e9-6cca-4a87-a01c-dea4b085f8a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1407 microversion: 2.20 time: 0.157937 Sep 22 17:14:55.056183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 456/910] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:54 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:56.081150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:56.081771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:56.088412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:56.088915 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:56.089333 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:56.090026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:56.090483 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:56.090913 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:56.224122 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:56.232346 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:56.233795 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:56.234897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-94ab457f-62a3-47bb-affb-56042cbe9d29 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1407 microversion: 2.20 time: 0.158069 Sep 22 17:14:56.235476 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 455/911] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:56 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:57.260523 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:57.261162 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:57.263596 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:57.270718 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:57.271242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:57.271683 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:57.272388 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:57.272843 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:57.273266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:57.420960 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:57.429899 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:57.431413 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:57.432580 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fb4733a3-1387-436a-9426-3735cfcd4192 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1598 microversion: 2.20 time: 0.176056 Sep 22 17:14:57.433142 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 457/912] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:14:57 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:14:57.457685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-aa2829fc-e7a1-4b78-8aa5-78f3e7b01917 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:57.458275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-aa2829fc-e7a1-4b78-8aa5-78f3e7b01917 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:57.464753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2829fc-e7a1-4b78-8aa5-78f3e7b01917 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:57.465317 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2829fc-e7a1-4b78-8aa5-78f3e7b01917 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:57.465663 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2829fc-e7a1-4b78-8aa5-78f3e7b01917 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:57.466359 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2829fc-e7a1-4b78-8aa5-78f3e7b01917 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:57.466910 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2829fc-e7a1-4b78-8aa5-78f3e7b01917 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:57.467263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aa2829fc-e7a1-4b78-8aa5-78f3e7b01917 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:57.469706 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:57.551946 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-aa2829fc-e7a1-4b78-8aa5-78f3e7b01917 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098490 Sep 22 17:14:57.552544 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 456/913] 10.222.0.16 () {60 vars in 1316 bytes} [Thu Sep 22 17:14:57 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:14:57.716103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:57.716103 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:57.723134 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:57.723629 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:57.724067 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:57.724773 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:57.725223 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:57.725655 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:57.841637 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lazy-loading 'services' on Instance uuid 273ac187-4613-4832-a9a4-4cf53828d55f {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:14:57.926664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9f9aa6b1-efe9-4d9d-8074-6a86784d9814 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "DELETE /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments/f1baa4f1-89d9-49f5-a443-2f0f6e979ce2" status: 202 len: 0 microversion: 2.1 time: 0.214905 Sep 22 17:14:57.927744 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 458/914] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:14:57 2022] DELETE /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments/f1baa4f1-89d9-49f5-a443-2f0f6e979ce2 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:14:57.939244 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b66a9efd-d4b2-44ce-b6bd-f864984a4e4e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:57.942374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b66a9efd-d4b2-44ce-b6bd-f864984a4e4e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:57.954407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b66a9efd-d4b2-44ce-b6bd-f864984a4e4e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:57.955171 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b66a9efd-d4b2-44ce-b6bd-f864984a4e4e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:57.955917 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b66a9efd-d4b2-44ce-b6bd-f864984a4e4e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:57.956957 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b66a9efd-d4b2-44ce-b6bd-f864984a4e4e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:57.957684 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b66a9efd-d4b2-44ce-b6bd-f864984a4e4e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:57.958261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b66a9efd-d4b2-44ce-b6bd-f864984a4e4e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:57.994117 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b66a9efd-d4b2-44ce-b6bd-f864984a4e4e tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060674 Sep 22 17:14:57.994994 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 457/915] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:14:57 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:58.807165 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-68eb5279-6105-40c1-8f77-92441686a8f2 req-852feb30-6535-4009-ae1f-531bdc7ac02d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3946f917-8585-453c-9eff-81ab4ba3b860", "tag": "53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:14:58.818682 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-68eb5279-6105-40c1-8f77-92441686a8f2 req-852feb30-6535-4009-ae1f-531bdc7ac02d service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:58.819196 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-68eb5279-6105-40c1-8f77-92441686a8f2 req-852feb30-6535-4009-ae1f-531bdc7ac02d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:58.819627 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-68eb5279-6105-40c1-8f77-92441686a8f2 req-852feb30-6535-4009-ae1f-531bdc7ac02d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:58.832608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-68eb5279-6105-40c1-8f77-92441686a8f2 req-852feb30-6535-4009-ae1f-531bdc7ac02d service nova] Creating event network-changed:53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7 for instance 3946f917-8585-453c-9eff-81ab4ba3b860 on hv-cinder-83538 Sep 22 17:14:58.838423 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-68eb5279-6105-40c1-8f77-92441686a8f2 req-852feb30-6535-4009-ae1f-531bdc7ac02d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035245 Sep 22 17:14:58.840456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 459/916] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:14:58.904270 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b895e1e2-cf0c-4045-b1ce-ed75355d1d35 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:58.906470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b895e1e2-cf0c-4045-b1ce-ed75355d1d35 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:58.912736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b895e1e2-cf0c-4045-b1ce-ed75355d1d35 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:58.913218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b895e1e2-cf0c-4045-b1ce-ed75355d1d35 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:58.913646 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b895e1e2-cf0c-4045-b1ce-ed75355d1d35 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:58.914367 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b895e1e2-cf0c-4045-b1ce-ed75355d1d35 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:58.915007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b895e1e2-cf0c-4045-b1ce-ed75355d1d35 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:58.915586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b895e1e2-cf0c-4045-b1ce-ed75355d1d35 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:58.946891 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b895e1e2-cf0c-4045-b1ce-ed75355d1d35 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046600 Sep 22 17:14:58.947861 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 458/917] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:14:58 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 17:14:59.010413 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9c389f28-2703-4c83-bb0f-5362e34ca04b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:59.015618 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9c389f28-2703-4c83-bb0f-5362e34ca04b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:59.017714 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:59.018223 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:59.024153 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c389f28-2703-4c83-bb0f-5362e34ca04b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:59.024808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c389f28-2703-4c83-bb0f-5362e34ca04b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:59.025295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:59.025567 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c389f28-2703-4c83-bb0f-5362e34ca04b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:59.025791 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:59.026627 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c389f28-2703-4c83-bb0f-5362e34ca04b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:59.027314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c389f28-2703-4c83-bb0f-5362e34ca04b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:59.027951 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c389f28-2703-4c83-bb0f-5362e34ca04b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:59.040103 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:59.041754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:59.044235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:59.045559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:59.066415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9c389f28-2703-4c83-bb0f-5362e34ca04b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062522 Sep 22 17:14:59.067203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 460/918] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:14:59 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:14:59.094573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:14:59.195114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a74a6f14-763a-4f90-a08d-51a23c045334 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 204 len: 0 microversion: 2.1 time: 0.180593 Sep 22 17:14:59.199428 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 459/919] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:14:59 2022] DELETE /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:14:59.210342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:14:59.211625 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:14:59.222843 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:59.224072 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:59.224892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:59.226202 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:14:59.227419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:14:59.228475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:14:59.237414 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:14:59.376495 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:14:59.384764 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d80bb250-6eaa-4fae-b5c6-64020f6f17fc tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1673 microversion: 2.1 time: 0.183028 Sep 22 17:14:59.385596 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 461/920] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:14:59 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:00.079476 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6e9fa775-ae18-4328-af9f-f56582798dd7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:00.081723 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6e9fa775-ae18-4328-af9f-f56582798dd7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:00.088131 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6e9fa775-ae18-4328-af9f-f56582798dd7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:00.088612 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6e9fa775-ae18-4328-af9f-f56582798dd7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:00.089047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6e9fa775-ae18-4328-af9f-f56582798dd7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:00.090062 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6e9fa775-ae18-4328-af9f-f56582798dd7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:00.090517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6e9fa775-ae18-4328-af9f-f56582798dd7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:00.090934 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6e9fa775-ae18-4328-af9f-f56582798dd7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:00.121490 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6e9fa775-ae18-4328-af9f-f56582798dd7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046371 Sep 22 17:15:00.122314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 460/921] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:15:00 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 17:15:00.206518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:00.207102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:00.213486 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:00.213975 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:00.214417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:00.215151 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:00.215612 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:00.216042 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:00.242541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:15:00.327601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b26d5998-501f-4311-a319-1677812cee86 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "DELETE /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 204 len: 0 microversion: 2.1 time: 0.124792 Sep 22 17:15:00.328190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 462/922] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:15:00 2022] DELETE /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:15:00.340811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:00.341413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:00.348083 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:00.348566 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:00.349000 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:00.349681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:00.350134 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:00.350554 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:00.408707 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:00.409440 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:00.421190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:00.422019 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:00.422656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:00.424033 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:00.424677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:00.425370 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:00.517887 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:00.525978 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d4151b4b-b6ee-463e-ba7f-fb86e50faeaf tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1688 microversion: 2.1 time: 0.189337 Sep 22 17:15:00.526550 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 461/923] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:00 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:00.577948 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:00.586516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2e7b2f25-4fa9-4340-ba5c-da4eae25386c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1673 microversion: 2.1 time: 0.182725 Sep 22 17:15:00.587086 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 463/924] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:00 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:01.550746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:01.551425 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:01.559527 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:01.560024 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:01.560464 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:01.561160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:01.561618 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:01.562320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:01.610095 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:01.610720 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:01.617755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:01.618233 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:01.618655 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:01.619365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:01.619811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:01.620227 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:01.757505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:01.765868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-52484692-99a1-4704-8596-10673bf1a346 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1688 microversion: 2.1 time: 0.219913 Sep 22 17:15:01.766452 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 462/925] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:01 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1688 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:01.789112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:01.796785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6e8c798c-4320-4f21-bfc2-6a29a3eb7fb9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1673 microversion: 2.1 time: 0.190557 Sep 22 17:15:01.797354 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 464/926] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:01 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1673 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:02.465734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6eb7869d-58fd-41b4-987c-d8f73ae71d3f tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:02.468045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6eb7869d-58fd-41b4-987c-d8f73ae71d3f tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:02.473961 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6eb7869d-58fd-41b4-987c-d8f73ae71d3f tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:02.474444 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6eb7869d-58fd-41b4-987c-d8f73ae71d3f tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:02.474880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6eb7869d-58fd-41b4-987c-d8f73ae71d3f tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:02.475605 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6eb7869d-58fd-41b4-987c-d8f73ae71d3f tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:02.476062 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6eb7869d-58fd-41b4-987c-d8f73ae71d3f tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:02.476486 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6eb7869d-58fd-41b4-987c-d8f73ae71d3f tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:02.548192 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6eb7869d-58fd-41b4-987c-d8f73ae71d3f tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "POST /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/action" status: 202 len: 0 microversion: 2.1 time: 0.085952 Sep 22 17:15:02.552473 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 463/927] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:15:02 2022] POST /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:15:02.557526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:02.558137 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:02.564979 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:02.565461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:02.565894 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:02.566592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:02.567070 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:02.567493 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:02.714888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:02.723381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1ec54ae5-710e-4eb7-88f8-eada998d7bb0 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1748 microversion: 2.1 time: 0.169604 Sep 22 17:15:02.723898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 465/928] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:02 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:02.790688 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:02.791424 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:02.797651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:02.798901 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:02.799356 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:02.800055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:02.800501 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:02.800922 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:02.820837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:02.821542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:02.828148 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:02.828722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:02.829232 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:02.829977 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:02.830426 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:02.830851 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:02.997417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:03.007716 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5faa0202-2eef-41e1-9109-ad06574451da tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1688 microversion: 2.1 time: 0.221710 Sep 22 17:15:03.008312 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 464/929] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:02 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:03.021007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:03.035611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f1fd3b0d-06ce-42ba-b4ef-37ef7598b9d2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1673 microversion: 2.1 time: 0.216008 Sep 22 17:15:03.036211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 466/930] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:02 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:03.747124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:03.747779 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:03.754578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:03.755099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:03.755541 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:03.756623 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:03.757088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:03.757520 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:03.903242 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:03.911513 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b027e56c-49d8-4948-8be2-0d56b6768a46 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1748 microversion: 2.1 time: 0.168328 Sep 22 17:15:03.912063 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 465/931] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:03 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:04.035341 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:04.035893 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:04.042621 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:04.043144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:04.044325 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:04.045035 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:04.045491 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:04.045914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:04.062218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:04.063269 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:04.071111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:04.071699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:04.072215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:04.072994 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:04.073578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:04.074074 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:04.339342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:04.343579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:04.348919 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-396d02e0-0709-4a8e-a292-0a2a86c9d584 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1688 microversion: 2.1 time: 0.317521 Sep 22 17:15:04.349503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 467/932] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:04 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1688 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:04.353626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-589e54a3-2547-4344-b8f5-c6cdefed97f0 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1673 microversion: 2.1 time: 0.296207 Sep 22 17:15:04.354192 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 466/933] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:04 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1673 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:04.935572 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:04.936191 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:04.943146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:04.943641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:04.944239 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:04.944959 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:04.945412 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:04.945834 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:05.301003 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:05.312259 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4a9d48d5-250b-4285-80b4-75cf18169195 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1748 microversion: 2.1 time: 0.381005 Sep 22 17:15:05.314414 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 468/934] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:04 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1748 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:05.376185 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:05.377993 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:05.379825 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:05.380694 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:05.386559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:05.388018 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:05.388655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:05.389569 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:05.389948 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:05.390437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:05.391027 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:05.391260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:05.391471 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:05.392865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:05.393395 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:05.393837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:05.580953 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:05.597970 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0bf036b9-5732-4398-b408-6391ad21a128 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1605 microversion: 2.1 time: 0.223120 Sep 22 17:15:05.607422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 469/935] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:05 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1605 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:05.709410 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:05.717914 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5dc391bf-b7ae-4149-ba49-9c14c5d34ca8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1688 microversion: 2.1 time: 0.348984 Sep 22 17:15:05.721768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 467/936] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:05 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1688 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:05.902247 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-5dbc2097-2a15-424a-9246-70118d0d7f5a req-a6eb8327-8b03-422d-aecb-322feaa40007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "979379b2-1673-4425-be3f-98d99729db47", "name": "network-vif-deleted", "tag": "e62c689f-694f-4650-961c-8b16b6ed4e18"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:05.932618 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-5dbc2097-2a15-424a-9246-70118d0d7f5a req-a6eb8327-8b03-422d-aecb-322feaa40007 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:05.933130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-5dbc2097-2a15-424a-9246-70118d0d7f5a req-a6eb8327-8b03-422d-aecb-322feaa40007 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:05.933559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-5dbc2097-2a15-424a-9246-70118d0d7f5a req-a6eb8327-8b03-422d-aecb-322feaa40007 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:05.947900 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-5dbc2097-2a15-424a-9246-70118d0d7f5a req-a6eb8327-8b03-422d-aecb-322feaa40007 service nova] Creating event network-vif-deleted:e62c689f-694f-4650-961c-8b16b6ed4e18 for instance 979379b2-1673-4425-be3f-98d99729db47 on hv-cinder-83538 Sep 22 17:15:05.952023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-5dbc2097-2a15-424a-9246-70118d0d7f5a req-a6eb8327-8b03-422d-aecb-322feaa40007 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057548 Sep 22 17:15:05.956356 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 470/937] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:06.051812 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-04b77d27-b361-41cd-a25f-a1201949b5af req-398066fc-d5f9-4c1f-9cc6-406e0dc0bf76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273ac187-4613-4832-a9a4-4cf53828d55f", "name": "network-vif-deleted", "tag": "f2393791-4dcd-48e5-ab8f-65b3058fd17e"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:06.062565 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-04b77d27-b361-41cd-a25f-a1201949b5af req-398066fc-d5f9-4c1f-9cc6-406e0dc0bf76 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:06.063166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-04b77d27-b361-41cd-a25f-a1201949b5af req-398066fc-d5f9-4c1f-9cc6-406e0dc0bf76 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:06.063774 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-04b77d27-b361-41cd-a25f-a1201949b5af req-398066fc-d5f9-4c1f-9cc6-406e0dc0bf76 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:06.076575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-04b77d27-b361-41cd-a25f-a1201949b5af req-398066fc-d5f9-4c1f-9cc6-406e0dc0bf76 service nova] Creating event network-vif-deleted:f2393791-4dcd-48e5-ab8f-65b3058fd17e for instance 273ac187-4613-4832-a9a4-4cf53828d55f on hv-cinder-83538 Sep 22 17:15:06.082189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-04b77d27-b361-41cd-a25f-a1201949b5af req-398066fc-d5f9-4c1f-9cc6-406e0dc0bf76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034867 Sep 22 17:15:06.087231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 468/938] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:06.344811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:06.353096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:06.367375 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:06.368215 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:06.368876 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:06.369604 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:06.370060 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:06.370673 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:06.546275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:06.555167 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3b30889f-dbc7-4c2d-92f3-6897ee859658 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.221949 Sep 22 17:15:06.556348 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 471/939] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:06 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:06.626090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:06.627438 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:06.633919 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:06.634630 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:06.635188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:06.636309 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:06.636833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:06.637349 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:06.675354 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:06.675842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:06.676276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:06.676721 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lazy-loading 'fault' on Instance uuid 979379b2-1673-4425-be3f-98d99729db47 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:15:06.722167 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:06.736161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-22cfe507-21a9-49ef-b58b-5946cb3a6d2a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 200 len: 1327 microversion: 2.1 time: 0.114274 Sep 22 17:15:06.736938 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 469/940] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:06 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:06.744264 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:06.745073 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:06.756635 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:06.757124 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:06.757557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:06.758433 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:06.759063 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:06.759639 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:06.792700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:06.793459 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:06.794042 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:06.794634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lazy-loading 'fault' on Instance uuid 273ac187-4613-4832-a9a4-4cf53828d55f {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:15:06.850082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:06.858706 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d03b8b9c-53d1-480e-8d4d-327f04ce7b57 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 200 len: 1334 microversion: 2.1 time: 0.118071 Sep 22 17:15:06.859341 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 472/941] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:06 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 1334 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:07.579758 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:07.580590 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:07.587177 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:07.587861 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:07.588477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:07.589431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:07.590011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:07.590443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:07.745234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:07.748745 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:07.760775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:07.761390 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:07.761530 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f697a408-7f22-4653-ac8e-d63ffe8e0a9c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.185615 Sep 22 17:15:07.771047 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:07.771533 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:07.771962 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:07.772670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:07.773108 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:07.773636 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:07.775156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 470/942] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:07 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:07.788142 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] HTTP exception thrown: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Request method failure captured: Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 HTTP/1.1 Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZJRi77leB-i9hVM_qo2B-vDF03ieah0VwDwTWBCauVRPRhdBbKNVWbdWetW_S4jF_Ylmya7Ngfyx8_ic8e2qM6NEIK7UNlN0QDatW6G5kOm1zCBw-F9WNzRvNO5GV6wsgVxAtA4c-c-i3-1FrzzbOrudP6xWuHwBfIw4bYpy1sWNk Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:15:07.790657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: 624f8fd9a74e48afa2f8b74b090a8dd6 Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:15:07.792382 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '979379b2-1673-4425-be3f-98d99729db47'} Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:15:07.793265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:15:07.794622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.795820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Returning 404 to user: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:15:07.795820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b78a79ec-e653-4d47-a3c1-0a01e93d5d1b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 404 len: 111 microversion: 2.1 time: 0.035288 Sep 22 17:15:07.795820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 473/943] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:07 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:15:07.801785 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6805e08d-8aef-4b49-ba78-190266f5a314 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '.version_select at 0x7f51d9362790>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:07.823259 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6805e08d-8aef-4b49-ba78-190266f5a314 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764573413" status: 202 len: 0 microversion: 2.1 time: 0.025784 Sep 22 17:15:07.823854 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 471/944] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 22 17:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764573413 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:15:07.883589 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:07.885175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: 273ac187-4613-4832-a9a4-4cf53828d55f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:07.892424 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:07.892910 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:07.893349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:07.894117 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:07.894562 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:07.895007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:07.910266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] HTTP exception thrown: Instance 273ac187-4613-4832-a9a4-4cf53828d55f could not be found. Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Request method failure captured: Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f HTTP/1.1 Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZTAFlLOJ4rlDfvtbyAuZ9FrBVULX3z83mdChpvcMKbEkHMTeqCkKMuDbiHkNn6OCActvwzsE_8Ru8WCEkA81Gs5jE3Dw2LR0eZwmLDDH1jY43QhcF4N-enqNZnxT1FGdBFnYdADAdXOM3mkbqkGHXLnwDMa-jzgA_ra6k4l1Dg8N8 Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:15:07.911890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_105c11557b6f45329dc97af01e8ea915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: bc8c2a5413c943ed94d76eceb2720f17 Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 273ac187-4613-4832-a9a4-4cf53828d55f could not be found. Sep 22 17:15:07.913647 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '273ac187-4613-4832-a9a4-4cf53828d55f'} Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273ac187-4613-4832-a9a4-4cf53828d55f could not be found. Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:15:07.914552 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273ac187-4613-4832-a9a4-4cf53828d55f could not be found. Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273ac187-4613-4832-a9a4-4cf53828d55f could not be found. Sep 22 17:15:07.916053 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:07.917291 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Returning 404 to user: Instance 273ac187-4613-4832-a9a4-4cf53828d55f could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:15:07.917291 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5f34e358-74cc-4ed3-93b5-8cab7f2e44ba tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f" status: 404 len: 111 microversion: 2.1 time: 0.034652 Sep 22 17:15:07.917291 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 474/945] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:07 2022] GET /compute/v2.1/servers/273ac187-4613-4832-a9a4-4cf53828d55f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:15:07.923360 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-89873153-01bd-4276-b88c-8013847b9267 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '.version_select at 0x7f51d9451dc0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:07.946204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-89873153-01bd-4276-b88c-8013847b9267 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-957986194" status: 202 len: 0 microversion: 2.1 time: 0.027150 Sep 22 17:15:07.946925 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 472/946] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 22 17:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-957986194 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:15:08.769304 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7ff5bf24-1a8b-4e8a-b2ac-04ed58725fc2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'create', calling method: .version_select at 0x7f51d94e6280>, body: {"keypair": {"name": "tempest-keypair-522213555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOssyVbVogFoJPKZL9c1i2V5+wLjpBjh7Hw7C9H9uzFF8b0yAjAdXVLC8GFlFbIHQ1QaYY7QQSsEGTUedm2bpg6g9vCqOr6RxTpPASfTdw0nKVEAIjVkQdSl6aIVcvm99g=="}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:08.786169 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-7ff5bf24-1a8b-4e8a-b2ac-04ed58725fc2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Getting quotas for project 2abeb0b54520461cb414ea9c0599380f. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:15:08.789050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:08.789771 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:08.790381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-7ff5bf24-1a8b-4e8a-b2ac-04ed58725fc2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Getting quotas for user 624f8fd9a74e48afa2f8b74b090a8dd6 and project 2abeb0b54520461cb414ea9c0599380f. Resources: {'key_pairs'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:15:08.796751 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:08.797330 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:08.798544 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:08.799273 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:08.799731 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:08.800235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:08.814422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7ff5bf24-1a8b-4e8a-b2ac-04ed58725fc2 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048557 Sep 22 17:15:08.815229 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 475/947] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:15:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:08.957357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:08.968017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9ec99f1d-a3d5-47e1-8e1c-fe8ae419f1bb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.183197 Sep 22 17:15:08.968658 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 473/948] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:08 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:09.997095 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:09.997708 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:10.005078 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:10.005550 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:10.005976 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:10.006657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:10.007141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:10.007556 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:10.137452 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1661516874", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ade9c12a-c9b5-416e-9a3a-173c84f0a9ae"}], "security_groups": [{"name": "tempest-securitygroup--1850206551"}], "key_name": "tempest-keypair-522213555", "user_data": "}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:10.180914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:10.190872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d6bad4d1-01f9-4adb-b65e-bca983051e16 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.198208 Sep 22 17:15:10.191539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 476/949] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:09 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:10.252200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] validate_networks() for [('ade9c12a-c9b5-416e-9a3a-173c84f0a9ae', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:15:10.630487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:15:10.630902 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:15:10.631414 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:15:10.631823 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:15:10.632258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:15:10.641538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:10.642015 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:10.642444 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:10.643195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:10.643648 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:10.644069 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:10.660833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Getting quotas for project 2abeb0b54520461cb414ea9c0599380f. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:15:10.664769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Getting quotas for user 624f8fd9a74e48afa2f8b74b090a8dd6 and project 2abeb0b54520461cb414ea9c0599380f. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:15:10.676585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:15:10.678882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:15:10.726579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8b2760fa-af91-4f9b-8b93-8957f7ee36da tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598911 Sep 22 17:15:10.727274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 474/950] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:15:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 17:15:10.739210 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4545b1b9-a979-45d4-a5a2-543bf020deb5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:10.739832 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4545b1b9-a979-45d4-a5a2-543bf020deb5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:10.798464 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4545b1b9-a979-45d4-a5a2-543bf020deb5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:10.805609 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4545b1b9-a979-45d4-a5a2-543bf020deb5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1237 microversion: 2.1 time: 0.070854 Sep 22 17:15:10.806219 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 477/951] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:10 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:10.938664 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:10.939088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:10.945519 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:10.946005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:10.946540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:10.947363 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:10.947799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:10.948221 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:10.977593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:15:11.059352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2a186aec-2de6-41c6-bf4e-67abcfdfa3b9 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 204 len: 0 microversion: 2.1 time: 0.124846 Sep 22 17:15:11.060212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 475/952] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:15:10 2022] DELETE /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:15:11.068358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:11.068963 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:11.075568 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:11.076066 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:11.076498 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:11.077378 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:11.077852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:11.078263 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:11.216218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:11.216930 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:11.223692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:11.224166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:11.224604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:11.225310 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:11.225761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:11.226183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:11.254537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:11.263352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b044f255-bc93-4e48-b0b7-8aadfa455ed7 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1506 microversion: 2.1 time: 0.198585 Sep 22 17:15:11.263729 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 478/953] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:11 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:11.390328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:11.400212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c6d0c4dc-7e25-46b9-a05b-2ab86dae993b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.188245 Sep 22 17:15:11.400710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 476/954] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:11 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:11.827837 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:11.828456 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:11.834477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:11.834997 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:11.835465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:11.836168 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:11.836619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:11.837045 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:11.900801 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:11.904398 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:11.909789 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d3b5926d-13f3-4ff8-9a71-8651a612401f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1289 microversion: 2.1 time: 0.085817 Sep 22 17:15:11.910365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 479/955] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:11 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:12.292925 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:12.293740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:12.296250 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:12.304852 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:12.305344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:12.305777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:12.306480 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:12.306926 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:12.307365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:12.424169 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:12.424790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:12.431835 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:12.432447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:12.432882 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:12.433786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:12.434245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:12.434844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:12.447378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:12.458368 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6dfd390b-a695-43fb-bdc2-35a751c0287a tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1506 microversion: 2.1 time: 0.169426 Sep 22 17:15:12.459321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 477/956] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:12 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:12.601522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:12.611858 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1e1d5e66-171b-4507-a3c5-f9c7814e6d0d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.191762 Sep 22 17:15:12.612596 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 480/957] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:12 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:12.700190 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-5132ad38-235a-46d5-9ce8-01f7aa9a61b9 req-5e046296-13a2-4704-9153-b3022301250d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb35797-a6cf-42af-9274-a2d6aadd2643", "name": "network-vif-deleted", "tag": "fd0e7b8c-420d-4637-a290-d9a8014bf255"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:12.712161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-5132ad38-235a-46d5-9ce8-01f7aa9a61b9 req-5e046296-13a2-4704-9153-b3022301250d service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:12.713366 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-5132ad38-235a-46d5-9ce8-01f7aa9a61b9 req-5e046296-13a2-4704-9153-b3022301250d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:12.713952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-5132ad38-235a-46d5-9ce8-01f7aa9a61b9 req-5e046296-13a2-4704-9153-b3022301250d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:12.727031 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-5132ad38-235a-46d5-9ce8-01f7aa9a61b9 req-5e046296-13a2-4704-9153-b3022301250d service nova] Creating event network-vif-deleted:fd0e7b8c-420d-4637-a290-d9a8014bf255 for instance cdb35797-a6cf-42af-9274-a2d6aadd2643 on hv-cinder-83538 Sep 22 17:15:12.735160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-5132ad38-235a-46d5-9ce8-01f7aa9a61b9 req-5e046296-13a2-4704-9153-b3022301250d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039179 Sep 22 17:15:12.741227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 478/958] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:12.941014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:12.942576 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:12.957767 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:12.959028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:12.959998 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:12.961490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:12.962592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:12.966467 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:13.066451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:13.077811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7618c47c-53a1-40e9-9d32-1b7337ac33e6 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1307 microversion: 2.1 time: 0.145604 Sep 22 17:15:13.078756 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 481/959] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:12 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1307 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:13.482418 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:13.483144 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:13.493154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:13.493954 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:13.494553 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:13.495461 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:13.496071 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:13.496777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:13.539523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:13.539908 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:13.540340 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:13.540801 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lazy-loading 'fault' on Instance uuid cdb35797-a6cf-42af-9274-a2d6aadd2643 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:15:13.633249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:13.634882 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:13.636093 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:13.642990 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:13.643706 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:13.644298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:13.644998 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:13.645123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b92d9ee9-5f24-4546-b0d0-dd4018fdfbd1 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 200 len: 1311 microversion: 2.1 time: 0.166921 Sep 22 17:15:13.645717 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:13.646293 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:13.659043 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 479/960] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:13 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:13.807767 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:13.816230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-479ae759-2b94-45ba-85fd-3076ab040705 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.185035 Sep 22 17:15:13.816824 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 482/961] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:13 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:14.103320 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:14.103942 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:14.111154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.111758 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.112428 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.113415 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.114125 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.114739 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.378106 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:14.387097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-11da769b-b4a1-4229-a686-b67fa803e937 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1363 microversion: 2.1 time: 0.288545 Sep 22 17:15:14.388437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 480/962] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:14 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:14.669988 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:14.670699 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: cdb35797-a6cf-42af-9274-a2d6aadd2643] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:14.677979 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.678461 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.678892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.679610 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.680056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.680474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.694985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] HTTP exception thrown: Instance cdb35797-a6cf-42af-9274-a2d6aadd2643 could not be found. Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Request method failure captured: Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 HTTP/1.1 Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZTAFlLOJ4rlDfvtbyAuZ9FrBVULX3z83mdChpvcMKbEkHMTeqCkKMuDbiHkNn6OCActvwzsE_8Ru8WCEkA81Gs5jE3Dw2LR0eZwmLDDH1jY43QhcF4N-enqNZnxT1FGdBFnYdADAdXOM3mkbqkGHXLnwDMa-jzgA_ra6k4l1Dg8N8 Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:15:14.696522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_105c11557b6f45329dc97af01e8ea915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: bc8c2a5413c943ed94d76eceb2720f17 Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance cdb35797-a6cf-42af-9274-a2d6aadd2643 could not be found. Sep 22 17:15:14.698064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'cdb35797-a6cf-42af-9274-a2d6aadd2643'} Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb35797-a6cf-42af-9274-a2d6aadd2643 could not be found. Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:15:14.698865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb35797-a6cf-42af-9274-a2d6aadd2643 could not be found. Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb35797-a6cf-42af-9274-a2d6aadd2643 could not be found. Sep 22 17:15:14.700141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:15:14.701270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Returning 404 to user: Instance cdb35797-a6cf-42af-9274-a2d6aadd2643 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:15:14.701270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b23bdbb3-5051-4e75-bbbd-abefd337d4b0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643" status: 404 len: 111 microversion: 2.1 time: 0.031980 Sep 22 17:15:14.701270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 483/963] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:14 2022] GET /compute/v2.1/servers/cdb35797-a6cf-42af-9274-a2d6aadd2643 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:15:14.707424 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:14.708084 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:14.714523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.715138 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.715638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.716400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.716940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.717488 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.744581 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:15:14.838097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-da54d9ac-a87d-4e8b-817b-59e7e0e74698 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 204 len: 0 microversion: 2.1 time: 0.134397 Sep 22 17:15:14.841740 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 481/964] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:15:14 2022] DELETE /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:15:14.842852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-070c2be1-ff20-423b-9e92-ae3343a21bbb req-252fe1c5-ff1b-4ba2-b65a-84eb89d7fd33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c17e4e-de77-41fc-b8a7-b73a85afe377", "tag": "f3b5bffd-1d78-4175-8bd6-0243dd912596"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:14.847417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:14.848704 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:14.857289 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.858389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.858877 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.859899 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-070c2be1-ff20-423b-9e92-ae3343a21bbb req-252fe1c5-ff1b-4ba2-b65a-84eb89d7fd33 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.860220 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.861265 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.861540 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-070c2be1-ff20-423b-9e92-ae3343a21bbb req-252fe1c5-ff1b-4ba2-b65a-84eb89d7fd33 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.861738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.862160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-070c2be1-ff20-423b-9e92-ae3343a21bbb req-252fe1c5-ff1b-4ba2-b65a-84eb89d7fd33 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.877302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-070c2be1-ff20-423b-9e92-ae3343a21bbb req-252fe1c5-ff1b-4ba2-b65a-84eb89d7fd33 service nova] Creating event network-changed:f3b5bffd-1d78-4175-8bd6-0243dd912596 for instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 on hv-cinder-83538 Sep 22 17:15:14.883512 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-070c2be1-ff20-423b-9e92-ae3343a21bbb req-252fe1c5-ff1b-4ba2-b65a-84eb89d7fd33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052620 Sep 22 17:15:14.884812 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 484/965] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:15:14.899377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:14.900179 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:14.906689 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.907872 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.908384 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:14.909165 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:14.909696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:14.910194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:15.091940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:15.104074 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-32a5480f-a78f-4d40-b760-c158b0b8398b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.262816 Sep 22 17:15:15.111068 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 482/966] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:14 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:15.116202 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:15.130328 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d7413314-85fd-4eb3-bbcd-4be99fff2eb8 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.243999 Sep 22 17:15:15.131442 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 485/967] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:14 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:15.415161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:15.415790 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:15.422225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:15.423009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:15.423463 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:15.424180 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:15.424635 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:15.425070 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:15.569385 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:15.577490 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-dce0de61-a8d4-437e-98df-93d36fbd23ad tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1363 microversion: 2.1 time: 0.166193 Sep 22 17:15:15.578068 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 483/968] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:15 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:16.130732 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:16.131361 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:16.138250 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:16.138736 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:16.139201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:16.139905 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:16.140359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:16.140783 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:16.153694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:16.154337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:16.161651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:16.162406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:16.162852 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:16.163608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:16.164066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:16.164529 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:16.384973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:16.387777 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:16.394041 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f3e45354-74b5-44a9-b38a-6354ab149b1d tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.268027 Sep 22 17:15:16.394634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 486/969] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:16 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:16.397683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4a72af6b-37d7-423f-8a3c-576b9f217735 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.247701 Sep 22 17:15:16.398439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 484/970] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:16 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:16.601344 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:16.601969 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:16.607958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:16.608440 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:16.608871 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:16.609555 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:16.610006 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:16.611154 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:16.755404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:16.763340 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-22fa51ea-b97d-478f-890a-cc425680ce8b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1363 microversion: 2.1 time: 0.165855 Sep 22 17:15:16.763893 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 487/971] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:16 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:17.417685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:17.418314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:17.422233 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:17.423158 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:17.425184 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:17.425675 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:17.426118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:17.426812 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:17.427285 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:17.427701 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:17.429811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:17.430302 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:17.430743 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:17.431475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:17.431933 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:17.432392 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:17.642696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:17.648844 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:17.650870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1ce744e8-f54b-4c72-a98e-fd3dd1afa899 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.233053 Sep 22 17:15:17.651482 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 488/972] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:17 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:17.657428 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-17e48100-502c-4449-9092-bfdcdbff68aa tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.243592 Sep 22 17:15:17.658082 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 485/973] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:17 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:17.786958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:17.787592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:17.793985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:17.794480 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:17.794918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:17.795671 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:17.796125 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:17.796550 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:17.930606 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:17.938472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dcac12fe-d4d7-4e05-9f98-553010d4acf7 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1363 microversion: 2.1 time: 0.155433 Sep 22 17:15:17.939066 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 489/974] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:17 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:18.681857 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:18.682469 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:18.688749 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:18.689329 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:18.689439 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:18.689706 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:18.689840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:18.690540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:18.691230 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:18.691820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:18.697447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:18.698042 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:18.698700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:18.699510 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:18.700036 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:18.700559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:19.013085 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:19.022465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:19.022978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fa14038e-3a23-42d6-9922-b743ddde24e4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1753 microversion: 2.1 time: 0.338457 Sep 22 17:15:19.029314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 490/975] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:18 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1753 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:19.036128 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-aace871b-fa0f-43cf-812f-3e3dfff6548b tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1520 microversion: 2.1 time: 0.358196 Sep 22 17:15:19.037419 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 486/976] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:18 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:19.042719 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:19.043928 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:19.056108 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:19.057025 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:19.057813 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:19.059177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:19.060047 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:19.060851 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:19.224767 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-05eef7b6-9949-4234-9d46-1c1c752c5da1 req-9ffb45d1-f6d9-40f6-b079-0110d4484655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7947f62-c48e-4f60-b109-295247f6e1aa", "name": "network-vif-deleted", "tag": "d0d3ad94-b2b0-4603-b33c-ae0e3280fa0c"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:19.235337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-05eef7b6-9949-4234-9d46-1c1c752c5da1 req-9ffb45d1-f6d9-40f6-b079-0110d4484655 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:19.235836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-05eef7b6-9949-4234-9d46-1c1c752c5da1 req-9ffb45d1-f6d9-40f6-b079-0110d4484655 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:19.236282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-05eef7b6-9949-4234-9d46-1c1c752c5da1 req-9ffb45d1-f6d9-40f6-b079-0110d4484655 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:19.239277 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:19.251462 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-05eef7b6-9949-4234-9d46-1c1c752c5da1 req-9ffb45d1-f6d9-40f6-b079-0110d4484655 service nova] Creating event network-vif-deleted:d0d3ad94-b2b0-4603-b33c-ae0e3280fa0c for instance b7947f62-c48e-4f60-b109-295247f6e1aa on hv-cinder-83538 Sep 22 17:15:19.257101 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-05eef7b6-9949-4234-9d46-1c1c752c5da1 req-9ffb45d1-f6d9-40f6-b079-0110d4484655 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036204 Sep 22 17:15:19.257703 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 487/977] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:15:19.272929 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:19.280896 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b4df72d4-e53d-4bf7-9517-f9ebcfb1f419 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1363 microversion: 2.1 time: 0.250023 Sep 22 17:15:19.281479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 491/978] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:19 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:20.052232 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:20.053087 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:20.060744 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.061180 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.061612 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:20.062313 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.063295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.064236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:20.064920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:20.065538 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:20.072607 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.073104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.073917 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:20.074823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.075398 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.075645 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:20.114863 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.115416 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.115851 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:20.116334 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lazy-loading 'fault' on Instance uuid b7947f62-c48e-4f60-b109-295247f6e1aa {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:15:20.184315 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8c2a5413c943ed94d76eceb2720f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c11557b6f45329dc97af01e8ea915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:20.194175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7a4c03ad-073f-4a86-ab1b-1409f4b06cca tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 200 len: 1311 microversion: 2.1 time: 0.133757 Sep 22 17:15:20.196001 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 492/979] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:20 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:20.295869 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:20.306574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:20.307336 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:20.308328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4cebcae7-b7ad-4b5a-802a-a6f2d5e3a83a tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1756 microversion: 2.1 time: 0.263589 Sep 22 17:15:20.324053 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 488/980] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:20 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1756 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:20.328912 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.329695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.330279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:20.331067 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.331547 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.332831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:20.494005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:20.503681 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-26bb7911-05b0-4152-bfc8-daa8ffd26623 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1363 microversion: 2.1 time: 0.202139 Sep 22 17:15:20.504449 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 493/981] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:20 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:20.824648 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:20.825397 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:20.828045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:20.829559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:20.837599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.838143 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.838540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:20.839359 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.839920 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.840343 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:20.877944 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:15:20.977381 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8280e0a9-f16c-4b03-ad4c-f641a2073129 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 204 len: 0 microversion: 2.1 time: 0.157880 Sep 22 17:15:20.978143 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 489/982] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:15:20 2022] DELETE /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:15:20.988652 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:20.989631 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:20.991620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:20.998634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:20.999173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:20.999623 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:21.000356 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:21.001365 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:21.001796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:21.155632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:21.163658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4181d673-f893-4e27-b016-b0b2137eba8d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1576 microversion: 2.1 time: 0.180789 Sep 22 17:15:21.164250 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 494/983] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:20 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:21.234385 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:21.235115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] [instance: b7947f62-c48e-4f60-b109-295247f6e1aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:21.241657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:21.242143 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:21.242576 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:21.243306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:21.243767 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:21.244194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:21.264952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] HTTP exception thrown: Instance b7947f62-c48e-4f60-b109-295247f6e1aa could not be found. Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Request method failure captured: Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa HTTP/1.1 Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZTAFlLOJ4rlDfvtbyAuZ9FrBVULX3z83mdChpvcMKbEkHMTeqCkKMuDbiHkNn6OCActvwzsE_8Ru8WCEkA81Gs5jE3Dw2LR0eZwmLDDH1jY43QhcF4N-enqNZnxT1FGdBFnYdADAdXOM3mkbqkGHXLnwDMa-jzgA_ra6k4l1Dg8N8 Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:15:21.267291 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/105c11557b6f45329dc97af01e8ea915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_105c11557b6f45329dc97af01e8ea915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 105c11557b6f45329dc97af01e8ea915 Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-195535715 Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: bc8c2a5413c943ed94d76eceb2720f17 Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-ServerRescueNegativeTestJSON-195535715-project Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance b7947f62-c48e-4f60-b109-295247f6e1aa could not be found. Sep 22 17:15:21.269770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': 'b7947f62-c48e-4f60-b109-295247f6e1aa'} Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7947f62-c48e-4f60-b109-295247f6e1aa could not be found. Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:15:21.271650 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7947f62-c48e-4f60-b109-295247f6e1aa could not be found. Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7947f62-c48e-4f60-b109-295247f6e1aa could not be found. Sep 22 17:15:21.274365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:21.276413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] Returning 404 to user: Instance b7947f62-c48e-4f60-b109-295247f6e1aa could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:15:21.276413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d77b98c3-e84f-42ea-a20c-b30180c9b5d0 tempest-ServerRescueNegativeTestJSON-195535715 tempest-ServerRescueNegativeTestJSON-195535715-project] 10.222.0.16 "GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa" status: 404 len: 111 microversion: 2.1 time: 0.038736 Sep 22 17:15:21.276413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 490/984] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:21 2022] GET /compute/v2.1/servers/b7947f62-c48e-4f60-b109-295247f6e1aa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:15:21.527591 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:21.528216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:21.535186 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:21.535712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:21.536152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:21.536869 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:21.537327 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:21.537751 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:21.684545 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:21.693125 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-07f5ea88-2c5f-4984-b2a4-7c16d8da4084 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1363 microversion: 2.1 time: 0.169538 Sep 22 17:15:21.693732 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 495/985] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:21 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:22.189118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:22.190044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:22.197792 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:22.198667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:22.199297 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:22.200214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:22.200725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:22.201235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:22.361128 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:22.369384 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-782f6e2c-74e3-43b5-9103-d06bf1763906 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1576 microversion: 2.1 time: 0.185820 Sep 22 17:15:22.369968 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 491/986] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:22 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:22.511194 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-74716919-30c0-4800-9f64-ec5efd2eb364 req-9c96fc04-60c6-4b10-bda8-6404b42f0737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c17e4e-de77-41fc-b8a7-b73a85afe377", "name": "network-vif-plugged", "status": "completed", "tag": "f3b5bffd-1d78-4175-8bd6-0243dd912596"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:22.520148 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:22.528910 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-74716919-30c0-4800-9f64-ec5efd2eb364 req-9c96fc04-60c6-4b10-bda8-6404b42f0737 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:22.529484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-74716919-30c0-4800-9f64-ec5efd2eb364 req-9c96fc04-60c6-4b10-bda8-6404b42f0737 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:22.530008 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-74716919-30c0-4800-9f64-ec5efd2eb364 req-9c96fc04-60c6-4b10-bda8-6404b42f0737 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:22.544703 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-74716919-30c0-4800-9f64-ec5efd2eb364 req-9c96fc04-60c6-4b10-bda8-6404b42f0737 service nova] Creating event network-vif-plugged:f3b5bffd-1d78-4175-8bd6-0243dd912596 for instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 on hv-cinder-83538 Sep 22 17:15:22.550458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-74716919-30c0-4800-9f64-ec5efd2eb364 req-9c96fc04-60c6-4b10-bda8-6404b42f0737 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043034 Sep 22 17:15:22.552438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 496/987] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:22.717709 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:22.718636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:22.725378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:22.726026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:22.726560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:22.727480 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:22.728168 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:22.728719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:22.893223 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:22.901448 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1f499882-f394-494d-8b91-4bc6228a185f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1363 microversion: 2.1 time: 0.187519 Sep 22 17:15:22.902031 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 492/988] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:22 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:23.394742 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:23.395494 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:23.401914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:23.402420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:23.402859 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:23.403611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:23.404080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:23.404776 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:23.764231 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:23.773792 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-492812d9-bc54-4b27-8ade-bf8eac7f9248 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1576 microversion: 2.1 time: 0.383976 Sep 22 17:15:23.774377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 497/989] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:23 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1576 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:23.924277 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:23.925068 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:23.931579 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:23.932161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:23.932660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:23.933460 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:23.933979 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:23.934478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:24.307413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:24.317009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e652e663-1004-44fe-b822-d512725d7412 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1363 microversion: 2.1 time: 0.396877 Sep 22 17:15:24.318293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 493/990] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:23 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:24.800301 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:24.801189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:24.807875 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:24.808385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:24.808817 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:24.809790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:24.810305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:24.810794 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:24.816288 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=100 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:24.939043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:24.947291 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-08d9db16-9fea-4600-ba76-6e403064dc6f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1509 microversion: 2.1 time: 0.152366 Sep 22 17:15:24.947877 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 498/991] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:24 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:25.322982 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-6cfe096f-b0c6-439e-8461-3c4dbc040b98 req-e464df45-309e-4eed-9738-803a13ba0dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6348b1f-b623-42cb-a0dc-a33cf088486a", "name": "network-vif-deleted", "tag": "29509342-40b1-4e83-8923-eccd29758d12"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:25.345338 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:25.346340 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:25.349306 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-6cfe096f-b0c6-439e-8461-3c4dbc040b98 req-e464df45-309e-4eed-9738-803a13ba0dc8 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:25.350581 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-6cfe096f-b0c6-439e-8461-3c4dbc040b98 req-e464df45-309e-4eed-9738-803a13ba0dc8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:25.351621 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-6cfe096f-b0c6-439e-8461-3c4dbc040b98 req-e464df45-309e-4eed-9738-803a13ba0dc8 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:25.357623 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:25.358324 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:25.359137 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:25.360892 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:25.361664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:25.363466 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:25.376813 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-6cfe096f-b0c6-439e-8461-3c4dbc040b98 req-e464df45-309e-4eed-9738-803a13ba0dc8 service nova] Creating event network-vif-deleted:29509342-40b1-4e83-8923-eccd29758d12 for instance b6348b1f-b623-42cb-a0dc-a33cf088486a on hv-cinder-83538 Sep 22 17:15:25.387384 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-6cfe096f-b0c6-439e-8461-3c4dbc040b98 req-e464df45-309e-4eed-9738-803a13ba0dc8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081336 Sep 22 17:15:25.395839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 494/992] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:25.577093 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:25.586657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8f4c9dab-384a-4024-8a64-f1ba16c00b3a tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1548 microversion: 2.1 time: 0.249108 Sep 22 17:15:25.591008 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 499/993] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:25 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1548 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:25.617391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-29faba64-9715-4e95-a551-d972396cbd60 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:25.618606 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-29faba64-9715-4e95-a551-d972396cbd60 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:25.631129 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-29faba64-9715-4e95-a551-d972396cbd60 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:25.632598 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-29faba64-9715-4e95-a551-d972396cbd60 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:25.633752 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-29faba64-9715-4e95-a551-d972396cbd60 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:25.636443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-29faba64-9715-4e95-a551-d972396cbd60 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:25.642493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-29faba64-9715-4e95-a551-d972396cbd60 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:25.643826 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-29faba64-9715-4e95-a551-d972396cbd60 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:25.929588 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-29faba64-9715-4e95-a551-d972396cbd60 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.316736 Sep 22 17:15:25.931575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 495/994] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 22 17:15:25 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-interface => generated 284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:25.997753 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:26.001258 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:26.020250 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:26.022399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:26.028599 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:26.030384 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:26.032358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:26.033735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:26.131612 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:26.133145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:26.134157 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:26.136366 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lazy-loading 'fault' on Instance uuid b6348b1f-b623-42cb-a0dc-a33cf088486a {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:15:26.229804 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:26.264959 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-810ce58a-43b7-4658-baf8-25993ececaf5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 200 len: 1229 microversion: 2.1 time: 0.295369 Sep 22 17:15:26.266206 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 500/995] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:25 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 1229 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:27.290828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:27.291614 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:27.301755 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:27.302253 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:27.302686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:27.303441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:27.303895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:27.304315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:27.321900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] HTTP exception thrown: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Request method failure captured: Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a HTTP/1.1 Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJc4_raI65d81oxfM7Ak-LcDNH7P_Bs6t6No1JjA4Jxvuk2vZgka021i53e3QdmXxUPMdMaabk_zrgKZqZ-jd1kZdl14CeEXxHz1y5hGHugNR35PuCQw5sssJy0E9tpCJ3sHJx4WwOovC_0Oa1fQlpHZUe1ZfKccYHiEWx8MDTxZiCg Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:15:27.323655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-TestVolumeBootPattern-85944829 Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: c2060b33d0a24e01a96ab3fb02b4b045 Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:15:27.325314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': 'b6348b1f-b623-42cb-a0dc-a33cf088486a'} Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:15:27.326322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:15:27.327842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:15:27.330434 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Returning 404 to user: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:15:27.331526 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-deffaeaa-ceef-498a-ba71-7ed65e357002 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 404 len: 111 microversion: 2.1 time: 0.045323 Sep 22 17:15:27.341952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 496/996] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:27 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:15:27.509983 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1510909777", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-880029579", "security_groups": [{"name": "tempest-secgroup-smoke-805804894"}], "block_device_mapping_v2": [{"uuid": "795f6a05-0aec-469a-afd4-632956ec2627", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1876d1ce-e761-46f2-ab46-b61110e15c2c"}]}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:27.568608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-d6282833-18c8-4ad4-ba71-85d5c6f4f3cf req-d968e5ff-3010-46c4-8a63-baaba1e8f977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30c17e4e-de77-41fc-b8a7-b73a85afe377", "tag": "f3b5bffd-1d78-4175-8bd6-0243dd912596"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:27.610254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d6282833-18c8-4ad4-ba71-85d5c6f4f3cf req-d968e5ff-3010-46c4-8a63-baaba1e8f977 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:27.614079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d6282833-18c8-4ad4-ba71-85d5c6f4f3cf req-d968e5ff-3010-46c4-8a63-baaba1e8f977 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:27.615399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d6282833-18c8-4ad4-ba71-85d5c6f4f3cf req-d968e5ff-3010-46c4-8a63-baaba1e8f977 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:27.650136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-d6282833-18c8-4ad4-ba71-85d5c6f4f3cf req-d968e5ff-3010-46c4-8a63-baaba1e8f977 service nova] Creating event network-changed:f3b5bffd-1d78-4175-8bd6-0243dd912596 for instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 on hv-cinder-83538 Sep 22 17:15:27.658138 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-d6282833-18c8-4ad4-ba71-85d5c6f4f3cf req-d968e5ff-3010-46c4-8a63-baaba1e8f977 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106704 Sep 22 17:15:27.660829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 497/997] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:27.688412 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.network.neutron [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] validate_networks() for [('1876d1ce-e761-46f2-ab46-b61110e15c2c', None, None, None, None, None)] {{(pid=120805) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:15:28.722546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Flavor limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:15:28.723269 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Image limits 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:15:28.724207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Flavor pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:15:28.724992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Image pref 0:0:0 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:15:28.725827 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.virt.hardware [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120805) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:15:28.745656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:28.747109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:28.748584 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:28.749780 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:28.750555 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:28.751088 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:28.774206 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Getting quotas for project 5fca6eabbca24bc09aee7e259ca82562. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:15:28.780227 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.quota [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Getting quotas for user c2060b33d0a24e01a96ab3fb02b4b045 and project 5fca6eabbca24bc09aee7e259ca82562. Resources: {'cores', 'ram', 'instances'} {{(pid=120805) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:15:28.853022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Going to run 1 instances... {{(pid=120805) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:15:28.855594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='795f6a05-0aec-469a-afd4-632956ec2627',volume_size=None,volume_type=None)] {{(pid=120805) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:15:29.080840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0f1da39c-5bcc-49c1-b4c8-ce378da6b6bd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.577862 Sep 22 17:15:29.084559 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 501/998] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:15:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:15:29.097314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9d0b4016-0977-4a1d-a1da-88b5d4073aa7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:29.098019 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9d0b4016-0977-4a1d-a1da-88b5d4073aa7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:29.166575 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9d0b4016-0977-4a1d-a1da-88b5d4073aa7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:29.174446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9d0b4016-0977-4a1d-a1da-88b5d4073aa7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1094 microversion: 2.1 time: 0.082328 Sep 22 17:15:29.175338 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 498/999] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:29 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:30.199957 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:30.201203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:30.208489 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:30.209379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:30.209988 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:30.211283 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:30.212023 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:30.212454 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:30.307218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:30.324161 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fd7169c1-dd8a-4f4b-8748-cd4c783800c6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1192 microversion: 2.1 time: 0.127524 Sep 22 17:15:30.325033 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 502/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:30 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1192 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:31.351141 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:31.352670 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:31.362848 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:31.363494 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:31.364040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:31.364868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:31.365882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:31.366669 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:31.437477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:31.453016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-33031aa8-fd09-4e18-8780-ffa6cc64cbbc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1210 microversion: 2.1 time: 0.107417 Sep 22 17:15:31.453823 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 499/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:31 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:32.476361 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:32.476961 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:32.485967 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:32.486185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:32.486808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:32.487869 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:32.488537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:32.489065 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:32.721271 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:32.730676 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-beb6d209-287d-4d1c-9ec8-72e2b73f27c5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.258193 Sep 22 17:15:32.731335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 503/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:32 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:33.217897 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-c63b68cb-24fb-47e9-997c-e9880cf73690 req-46107c4f-dfda-4093-a717-ea74c2581c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a1d014-c233-453b-a917-67b7bce065fe", "tag": "719c0d8a-4075-405a-a311-23e6e4817a12"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:33.230497 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c63b68cb-24fb-47e9-997c-e9880cf73690 req-46107c4f-dfda-4093-a717-ea74c2581c71 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:33.231040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c63b68cb-24fb-47e9-997c-e9880cf73690 req-46107c4f-dfda-4093-a717-ea74c2581c71 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:33.231545 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c63b68cb-24fb-47e9-997c-e9880cf73690 req-46107c4f-dfda-4093-a717-ea74c2581c71 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:33.244722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-c63b68cb-24fb-47e9-997c-e9880cf73690 req-46107c4f-dfda-4093-a717-ea74c2581c71 service nova] Creating event network-changed:719c0d8a-4075-405a-a311-23e6e4817a12 for instance d4a1d014-c233-453b-a917-67b7bce065fe on hv-cinder-83538 Sep 22 17:15:33.250855 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-c63b68cb-24fb-47e9-997c-e9880cf73690 req-46107c4f-dfda-4093-a717-ea74c2581c71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037633 Sep 22 17:15:33.251848 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 500/1003] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:15:33.764762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:33.764762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:33.771282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:33.771921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:33.772359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:33.773080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:33.773522 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:33.774127 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:33.929370 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:33.937779 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1e08bc2b-00d6-4d79-9c74-5dcd72191fee tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.179302 Sep 22 17:15:33.938629 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 504/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:33 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:34.964728 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:34.965430 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:34.973264 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:34.973754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:34.974196 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:34.974906 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:34.975387 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:34.975818 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:35.227661 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:35.242354 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d2380a34-ffea-482c-a064-3f6f2d4d487b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.281863 Sep 22 17:15:35.243483 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 501/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:34 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:36.267258 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:36.267860 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:36.274518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:36.275038 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:36.275480 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:36.276185 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:36.276787 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:36.277218 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:36.423454 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:36.431517 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0d40b528-d64a-4b30-9bcc-cf3b67adcaca tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.169005 Sep 22 17:15:36.432092 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 505/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:36 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:37.454004 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:37.454603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:37.461339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:37.461814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:37.462242 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:37.462941 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:37.463417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:37.463833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:37.596817 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:37.604683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c710f5d3-7d65-4009-be74-b8a9c513aec4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.154671 Sep 22 17:15:37.605263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 502/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:37 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:15:38.628210 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:38.628821 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:38.635127 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:38.635609 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:38.636041 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:38.636728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:38.637178 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:38.637595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:38.764105 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:38.781547 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:38.791007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bfc4bb5c-3ea1-4ce7-a661-82e4220142b5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.167066 Sep 22 17:15:38.791758 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 506/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:38 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:39.815565 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:39.816170 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:39.819843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:39.824076 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:39.824563 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:39.824998 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:39.825690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:39.826144 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:39.826824 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:39.957532 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:39.967677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d8f450e5-30cf-42b1-8585-ae763034b19e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.156510 Sep 22 17:15:39.968269 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 503/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:39 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:40.990149 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:40.990770 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:40.993021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:40.998849 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:40.999368 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:40.999810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:41.000510 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:41.000968 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:41.001397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:41.142786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:41.150604 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-01aedaa9-f4fe-4759-b5b6-81c5d041f5ae tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.164705 Sep 22 17:15:41.151203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 507/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:40 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:42.174576 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:42.175315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:42.183032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:42.183536 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:42.183987 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:42.184703 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:42.185162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:42.185591 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:42.438386 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:42.447495 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3bc8d6d3-d280-42cb-bce9-eea1ac2f619e tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.277637 Sep 22 17:15:42.448098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 504/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:42 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:43.471828 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:43.472447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:43.479167 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:43.479656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:43.480093 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:43.480801 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:43.481259 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:43.481681 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:43.629159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:43.636999 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b3004a0c-dc4e-4ece-942b-2f3f761e2fe3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.169563 Sep 22 17:15:43.637547 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 508/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:43 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:44.660356 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:44.661037 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:44.663676 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:44.669392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:44.669887 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:44.670351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:44.671365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:44.672316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:44.673144 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:44.835456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:44.843828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-874ef70d-0a67-407c-a9b6-6b7eb0a5dd57 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.187489 Sep 22 17:15:44.844396 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 505/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:44 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:45.869604 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:45.870213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:45.878076 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:45.878560 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:45.879074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:45.879711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:45.880156 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:45.880571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:46.019252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:46.027243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-711a6200-8b00-4b19-836f-468aea0daf38 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.161556 Sep 22 17:15:46.027822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 509/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:45 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:46.739401 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-b50825cf-6243-40a2-a5e8-ec8f1d2e3bf6 req-a33c4f5f-3f6a-4753-a9d2-d7d9d66c3e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a1d014-c233-453b-a917-67b7bce065fe", "name": "network-vif-plugged", "status": "completed", "tag": "719c0d8a-4075-405a-a311-23e6e4817a12"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:46.766170 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-b50825cf-6243-40a2-a5e8-ec8f1d2e3bf6 req-a33c4f5f-3f6a-4753-a9d2-d7d9d66c3e4d service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:46.766170 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-b50825cf-6243-40a2-a5e8-ec8f1d2e3bf6 req-a33c4f5f-3f6a-4753-a9d2-d7d9d66c3e4d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:46.766549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-b50825cf-6243-40a2-a5e8-ec8f1d2e3bf6 req-a33c4f5f-3f6a-4753-a9d2-d7d9d66c3e4d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:46.777874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-b50825cf-6243-40a2-a5e8-ec8f1d2e3bf6 req-a33c4f5f-3f6a-4753-a9d2-d7d9d66c3e4d service nova] Creating event network-vif-plugged:719c0d8a-4075-405a-a311-23e6e4817a12 for instance d4a1d014-c233-453b-a917-67b7bce065fe on hv-cinder-83538 Sep 22 17:15:46.783546 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-b50825cf-6243-40a2-a5e8-ec8f1d2e3bf6 req-a33c4f5f-3f6a-4753-a9d2-d7d9d66c3e4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047784 Sep 22 17:15:46.784471 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 506/1015] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:47.051024 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:47.051900 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:47.058984 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:47.059480 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:47.059953 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:47.060628 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:47.061100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:47.061524 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:47.257282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:47.266017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-231dee73-8574-4144-9842-10bf85b1fc50 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.219541 Sep 22 17:15:47.266588 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 510/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:47 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:48.289182 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:48.289778 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:48.297273 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:48.298017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:48.298457 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:48.299204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:48.299658 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:48.300086 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:48.442341 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:48.450352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c0ce66c7-69dc-4628-9bad-11728c702842 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1265 microversion: 2.1 time: 0.165462 Sep 22 17:15:48.450921 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 507/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:48 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:49.473575 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:49.474346 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:49.481850 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:49.482349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:49.482790 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:49.483541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:49.484202 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:49.484614 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:49.635884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:49.644973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-914e6a18-8311-447e-a4da-9b2de0af65db tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1452 microversion: 2.1 time: 0.175583 Sep 22 17:15:49.645601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 511/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:49 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:49.667872 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:49.668498 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:49.675661 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:49.676166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:49.676652 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:49.677432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:49.677928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:49.678371 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:49.683399 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:49.838183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:15:49.846859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b399ae91-c4fb-493e-845b-41b30feeb108 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1452 microversion: 2.1 time: 0.182772 Sep 22 17:15:49.857417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 508/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:15:49 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:15:51.805081 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-e90c3ffc-6563-45d2-bd68-b73fe9c02935 req-a19d15af-ee1d-469b-88b0-7737c5b3f1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a1d014-c233-453b-a917-67b7bce065fe", "tag": "719c0d8a-4075-405a-a311-23e6e4817a12"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:51.814840 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e90c3ffc-6563-45d2-bd68-b73fe9c02935 req-a19d15af-ee1d-469b-88b0-7737c5b3f1c0 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:51.815360 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e90c3ffc-6563-45d2-bd68-b73fe9c02935 req-a19d15af-ee1d-469b-88b0-7737c5b3f1c0 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:51.815868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e90c3ffc-6563-45d2-bd68-b73fe9c02935 req-a19d15af-ee1d-469b-88b0-7737c5b3f1c0 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:51.827531 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-e90c3ffc-6563-45d2-bd68-b73fe9c02935 req-a19d15af-ee1d-469b-88b0-7737c5b3f1c0 service nova] Creating event network-changed:719c0d8a-4075-405a-a311-23e6e4817a12 for instance d4a1d014-c233-453b-a917-67b7bce065fe on hv-cinder-83538 Sep 22 17:15:51.832673 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-e90c3ffc-6563-45d2-bd68-b73fe9c02935 req-a19d15af-ee1d-469b-88b0-7737c5b3f1c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031248 Sep 22 17:15:51.833213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 512/1020] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:54.443244 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fd68f524-2b5a-4b69-8af2-6327460769ae tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:15:54.443700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fd68f524-2b5a-4b69-8af2-6327460769ae tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:54.449880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd68f524-2b5a-4b69-8af2-6327460769ae tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:54.450362 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd68f524-2b5a-4b69-8af2-6327460769ae tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:54.450797 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd68f524-2b5a-4b69-8af2-6327460769ae tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:54.451520 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd68f524-2b5a-4b69-8af2-6327460769ae tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:54.451974 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd68f524-2b5a-4b69-8af2-6327460769ae tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:54.452913 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fd68f524-2b5a-4b69-8af2-6327460769ae tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:54.476676 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fd68f524-2b5a-4b69-8af2-6327460769ae tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/ips" status: 200 len: 150 microversion: 2.1 time: 0.037294 Sep 22 17:15:54.477250 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 509/1021] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:15:54 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:55.865234 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a6f97707-1bbb-42e2-9382-44aa78072db6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c49fd44b-fdf2-4651-a82a-833a5fdc2553"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:55.867710 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a6f97707-1bbb-42e2-9382-44aa78072db6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:15:55.870733 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:55.874742 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6f97707-1bbb-42e2-9382-44aa78072db6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:55.875249 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6f97707-1bbb-42e2-9382-44aa78072db6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:55.875680 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6f97707-1bbb-42e2-9382-44aa78072db6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:55.876810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6f97707-1bbb-42e2-9382-44aa78072db6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:55.876810 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6f97707-1bbb-42e2-9382-44aa78072db6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:55.877216 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a6f97707-1bbb-42e2-9382-44aa78072db6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:55.881876 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=83 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:15:56.163648 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a6f97707-1bbb-42e2-9382-44aa78072db6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303291 Sep 22 17:15:56.164173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 513/1022] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:15:55 2022] POST /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:15:59.638977 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-381030269", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:15:59.691634 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] validate_networks() for None {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:15:59.966215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:15:59.966640 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:15:59.967160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:15:59.967584 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:15:59.968678 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:15:59.977442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:59.977928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:59.978401 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:59.979168 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:15:59.979628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:15:59.980088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:15:59.996969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Getting quotas for project 1443ca94374d4d3e89165346152d76e1. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:16:00.000974 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Getting quotas for user 015a74f1c0194f918e65723d4ec4d904 and project 1443ca94374d4d3e89165346152d76e1. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:16:00.011675 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:16:00.013937 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:16:00.059980 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-073355b3-cd21-4c25-b8cd-ce0980b499a1 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.424962 Sep 22 17:16:00.060631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 510/1023] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:15:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:16:00.072833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7dcca8b8-259c-4b9a-b390-151283e3c377 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:00.073659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7dcca8b8-259c-4b9a-b390-151283e3c377 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:00.132746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7dcca8b8-259c-4b9a-b390-151283e3c377 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:00.139991 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7dcca8b8-259c-4b9a-b390-151283e3c377 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1214 microversion: 2.1 time: 0.071953 Sep 22 17:16:00.140558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 514/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:00 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:01.163263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:01.163900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:01.170392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:01.170882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:01.171353 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:01.172045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:01.172767 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:01.173194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:01.234639 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:01.242459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c19882d6-04c4-44e9-9428-b38ae837e18b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1266 microversion: 2.1 time: 0.083780 Sep 22 17:16:01.243048 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 511/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:01 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:02.264846 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:02.265490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:02.273415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:02.273914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:02.274357 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:02.275089 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:02.275540 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:02.275966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:02.409602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:02.417189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7af9348b-ca15-40a7-ba7d-20599c6db702 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.156391 Sep 22 17:16:02.417781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 515/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:02 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:03.333604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-9eedf6da-c252-4875-8fc2-0d937d18777d req-61c608e5-8ae8-4f39-84bf-b87c47d3bdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce5e874-5a0e-4f05-9797-d1792cce3eab", "tag": "b0e0a1bc-7a19-4c29-bd56-63a6e98c34d3"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:03.344843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-9eedf6da-c252-4875-8fc2-0d937d18777d req-61c608e5-8ae8-4f39-84bf-b87c47d3bdf9 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:03.345359 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-9eedf6da-c252-4875-8fc2-0d937d18777d req-61c608e5-8ae8-4f39-84bf-b87c47d3bdf9 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:03.346002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-9eedf6da-c252-4875-8fc2-0d937d18777d req-61c608e5-8ae8-4f39-84bf-b87c47d3bdf9 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:03.361047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-9eedf6da-c252-4875-8fc2-0d937d18777d req-61c608e5-8ae8-4f39-84bf-b87c47d3bdf9 service nova] Creating event network-changed:b0e0a1bc-7a19-4c29-bd56-63a6e98c34d3 for instance bce5e874-5a0e-4f05-9797-d1792cce3eab on hv-cinder-83538 Sep 22 17:16:03.371478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-9eedf6da-c252-4875-8fc2-0d937d18777d req-61c608e5-8ae8-4f39-84bf-b87c47d3bdf9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041487 Sep 22 17:16:03.372088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 512/1027] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:03.442160 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:03.442978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:03.449740 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:03.450233 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:03.450672 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:03.451415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:03.451891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:03.452331 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:03.688359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:03.696248 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-face5cdf-f552-4850-884d-e2cb3e1468ab tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.258553 Sep 22 17:16:03.696900 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 516/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:03 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:03.738003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c49fd44b-fdf2-4651-a82a-833a5fdc2553"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:03.740495 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:03.746718 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:03.747236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:03.747674 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:03.748380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:03.748836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:03.749266 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:03.834262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Invalid volume: volume c49fd44b-fdf2-4651-a82a-833a5fdc2553 is already attached to instances: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: POST /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments HTTP/1.1 Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 74 Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:16:03.836055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {"volumeAttachment": {"volumeId": "c49fd44b-fdf2-4651-a82a-833a5fdc2553"}} Sep 22 17:16:03.837508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Invalid volume: volume c49fd44b-fdf2-4651-a82a-833a5fdc2553 is already attached to instances: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'server_id': '8ebb556d-d6b7-4759-8a5d-e6e5eea385b6', 'body': {'volumeAttachment': {'volumeId': 'c49fd44b-fdf2-4651-a82a-833a5fdc2553'}}} Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c49fd44b-fdf2-4651-a82a-833a5fdc2553 is already attached to instances: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:03.838282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c49fd44b-fdf2-4651-a82a-833a5fdc2553 is already attached to instances: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:03.839592 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:03.840833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:03.840833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:16:03.840833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:16:03.840833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c49fd44b-fdf2-4651-a82a-833a5fdc2553 is already attached to instances: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 Sep 22 17:16:03.840833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:03.840833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 400 to user: Invalid volume: volume c49fd44b-fdf2-4651-a82a-833a5fdc2553 is already attached to instances: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:16:03.840833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-35ad4ea3-a860-4946-92de-dcab6a986d20 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104449 Sep 22 17:16:03.840833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 513/1029] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:16:03 2022] POST /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:16:03.910064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:03.910566 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:03.916402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:03.916886 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:03.917319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:03.918007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:03.918458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:03.918881 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:04.000273 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'services' on Instance uuid 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:16:04.071571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7c0500f2-703e-4904-a13a-403c69b707f8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments/c49fd44b-fdf2-4651-a82a-833a5fdc2553" status: 202 len: 0 microversion: 2.1 time: 0.166873 Sep 22 17:16:04.072161 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 517/1030] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:16:03 2022] DELETE /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments/c49fd44b-fdf2-4651-a82a-833a5fdc2553 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:16:04.081215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4711bea4-e89c-44e8-8636-aeb38b213aed tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:04.083510 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4711bea4-e89c-44e8-8636-aeb38b213aed tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:04.089519 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4711bea4-e89c-44e8-8636-aeb38b213aed tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:04.090005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4711bea4-e89c-44e8-8636-aeb38b213aed tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:04.090446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4711bea4-e89c-44e8-8636-aeb38b213aed tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:04.091176 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4711bea4-e89c-44e8-8636-aeb38b213aed tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:04.091631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4711bea4-e89c-44e8-8636-aeb38b213aed tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:04.092058 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4711bea4-e89c-44e8-8636-aeb38b213aed tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:04.122877 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4711bea4-e89c-44e8-8636-aeb38b213aed tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046013 Sep 22 17:16:04.123411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 514/1031] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:16:04 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:04.719920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:04.720624 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:04.726798 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:04.727319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:04.727759 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:04.728450 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:04.728908 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:04.729336 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:04.863923 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:04.871546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9c61bf62-ee76-4dd6-a684-0b0c542814e0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.155941 Sep 22 17:16:04.872114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 518/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:04 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:05.136227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1d1a3ae3-47be-43b0-9423-7e1a4bda3d38 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:05.138541 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1d1a3ae3-47be-43b0-9423-7e1a4bda3d38 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:05.145053 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d1a3ae3-47be-43b0-9423-7e1a4bda3d38 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:05.145548 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d1a3ae3-47be-43b0-9423-7e1a4bda3d38 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:05.145992 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d1a3ae3-47be-43b0-9423-7e1a4bda3d38 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:05.146683 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d1a3ae3-47be-43b0-9423-7e1a4bda3d38 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:05.147178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d1a3ae3-47be-43b0-9423-7e1a4bda3d38 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:05.147608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1d1a3ae3-47be-43b0-9423-7e1a4bda3d38 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:05.178249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1d1a3ae3-47be-43b0-9423-7e1a4bda3d38 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046527 Sep 22 17:16:05.178820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 515/1033] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:16:05 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:05.894927 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:05.895565 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:05.902211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:05.902700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:05.903171 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:05.903863 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:05.904321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:05.904745 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:06.048535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:06.058047 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f098cced-d06a-495b-80e8-818958385c48 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.166940 Sep 22 17:16:06.058636 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 519/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:05 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:06.190795 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f9336794-759a-495e-866d-9a785a7338c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:06.192999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f9336794-759a-495e-866d-9a785a7338c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:06.199587 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f9336794-759a-495e-866d-9a785a7338c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:06.200061 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f9336794-759a-495e-866d-9a785a7338c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:06.200492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f9336794-759a-495e-866d-9a785a7338c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:06.201172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f9336794-759a-495e-866d-9a785a7338c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:06.201615 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f9336794-759a-495e-866d-9a785a7338c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:06.202256 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f9336794-759a-495e-866d-9a785a7338c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:06.231810 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f9336794-759a-495e-866d-9a785a7338c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 Sep 22 17:16:06.232358 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 516/1035] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:16:06 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:07.080453 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:07.080990 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:07.087472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:07.087957 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:07.088395 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:07.089113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:07.089595 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:07.090020 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:07.245117 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5346270e-2a8b-4452-a952-eaea886c0910 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:07.247352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5346270e-2a8b-4452-a952-eaea886c0910 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:07.254166 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:07.254874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5346270e-2a8b-4452-a952-eaea886c0910 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:07.255402 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5346270e-2a8b-4452-a952-eaea886c0910 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:07.255844 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5346270e-2a8b-4452-a952-eaea886c0910 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:07.256654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5346270e-2a8b-4452-a952-eaea886c0910 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:07.257030 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5346270e-2a8b-4452-a952-eaea886c0910 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:07.257460 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5346270e-2a8b-4452-a952-eaea886c0910 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:07.262387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-16c0d334-ba12-4ef4-bd81-89cee57fa7dd tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.185856 Sep 22 17:16:07.263295 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 520/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:07 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:07.291162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5346270e-2a8b-4452-a952-eaea886c0910 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050004 Sep 22 17:16:07.291957 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 517/1037] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:16:07 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:16:08.286007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:08.286786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:08.293276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:08.293768 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:08.294202 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:08.294899 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:08.295381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:08.295807 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:08.304154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fdc1ddd6-e52c-4ae6-a142-6fdc37b830d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:08.306347 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fdc1ddd6-e52c-4ae6-a142-6fdc37b830d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:08.313321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fdc1ddd6-e52c-4ae6-a142-6fdc37b830d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:08.313814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fdc1ddd6-e52c-4ae6-a142-6fdc37b830d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:08.314807 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fdc1ddd6-e52c-4ae6-a142-6fdc37b830d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:08.314934 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fdc1ddd6-e52c-4ae6-a142-6fdc37b830d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:08.315424 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fdc1ddd6-e52c-4ae6-a142-6fdc37b830d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:08.315851 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fdc1ddd6-e52c-4ae6-a142-6fdc37b830d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:08.346108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fdc1ddd6-e52c-4ae6-a142-6fdc37b830d8 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045792 Sep 22 17:16:08.346587 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 518/1038] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:16:08 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 17:16:08.413050 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:08.413547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:08.421984 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:08.422762 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:08.423234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:08.423997 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:08.424453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:08.424879 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:08.439697 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:08.448800 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9160a180-c88e-4cbc-87fc-6945db44d74f tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.166809 Sep 22 17:16:08.449390 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 521/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:08 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:08.450935 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:16:08.525077 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f1ad59ee-3d0f-432f-8950-b707972e1e9c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 204 len: 0 microversion: 2.1 time: 0.116615 Sep 22 17:16:08.525768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 519/1040] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:16:08 2022] DELETE /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:16:08.535646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:08.536285 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:08.543041 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:08.543537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:08.543980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:08.544689 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:08.545137 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:08.546058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:08.673961 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:08.681641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0c812660-80be-45f5-9362-bf2e6d378f76 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1682 microversion: 2.1 time: 0.151501 Sep 22 17:16:08.682195 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 522/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:08 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:16:09.472969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:09.473685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:09.480520 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:09.481014 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:09.481458 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:09.482170 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:09.482628 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:09.483086 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:09.621377 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:09.637547 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4b1043cf-936d-4606-a929-402ad39923b6 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.168816 Sep 22 17:16:09.638398 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 520/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:09 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:09.706189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:09.706806 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:09.713335 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:09.713819 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:09.714251 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:09.714939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:09.715415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:09.715858 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:09.844100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:09.851939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bc80b51b-94a1-4e6d-be6d-bd43616a44cc tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1682 microversion: 2.1 time: 0.150276 Sep 22 17:16:09.852538 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 523/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:09 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:10.661156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:10.661699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:10.663636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:10.664536 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:10.670709 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:10.671223 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:10.671664 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:10.672616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:10.673070 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:10.673495 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:10.807613 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:10.816080 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d5de2bed-b435-4c2c-84b8-2cde2a8fedcf tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.158916 Sep 22 17:16:10.816658 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 521/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:10 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:10.875262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:10.876381 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:10.878373 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:10.887594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:10.887594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:10.887594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:10.887594 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:10.888071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:10.888071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:11.063167 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:11.074118 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1744b5c2-84e7-49db-a64f-aa3922c9256e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1682 microversion: 2.1 time: 0.202508 Sep 22 17:16:11.074626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 524/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:10 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:11.131389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-7967473e-2f70-4023-9cda-e70c1071a121 req-67eeb925-d8c0-444d-bc3b-1bddaba3bb32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce5e874-5a0e-4f05-9797-d1792cce3eab", "name": "network-vif-plugged", "status": "completed", "tag": "b0e0a1bc-7a19-4c29-bd56-63a6e98c34d3"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:11.146717 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-7967473e-2f70-4023-9cda-e70c1071a121 req-67eeb925-d8c0-444d-bc3b-1bddaba3bb32 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:11.147507 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-7967473e-2f70-4023-9cda-e70c1071a121 req-67eeb925-d8c0-444d-bc3b-1bddaba3bb32 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:11.147930 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-7967473e-2f70-4023-9cda-e70c1071a121 req-67eeb925-d8c0-444d-bc3b-1bddaba3bb32 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:11.171302 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-7967473e-2f70-4023-9cda-e70c1071a121 req-67eeb925-d8c0-444d-bc3b-1bddaba3bb32 service nova] Creating event network-vif-plugged:b0e0a1bc-7a19-4c29-bd56-63a6e98c34d3 for instance bce5e874-5a0e-4f05-9797-d1792cce3eab on hv-cinder-83538 Sep 22 17:16:11.177521 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-7967473e-2f70-4023-9cda-e70c1071a121 req-67eeb925-d8c0-444d-bc3b-1bddaba3bb32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050271 Sep 22 17:16:11.178107 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 522/1046] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:11.839127 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:11.839774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:11.846636 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:11.847170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:11.847606 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:11.848672 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:11.849513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:11.851174 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:12.081426 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:12.092052 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e10b1881-41b4-4aaa-99f7-10b2a68f7131 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.256215 Sep 22 17:16:12.103990 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 525/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:11 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:12.119623 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:12.120344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:12.128094 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:12.128936 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:12.130121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:12.131814 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:12.132276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:12.132956 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:12.164516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-42a966a1-37d2-4228-be46-daa4c2e5ff69 req-e1e5e909-151c-46df-a569-fe9f9c40f557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebb556d-d6b7-4759-8a5d-e6e5eea385b6", "name": "network-vif-deleted", "tag": "f9873726-23b4-4ccc-b694-5a56db8cb7db"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:12.176056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-42a966a1-37d2-4228-be46-daa4c2e5ff69 req-e1e5e909-151c-46df-a569-fe9f9c40f557 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:12.177002 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-42a966a1-37d2-4228-be46-daa4c2e5ff69 req-e1e5e909-151c-46df-a569-fe9f9c40f557 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:12.177610 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-42a966a1-37d2-4228-be46-daa4c2e5ff69 req-e1e5e909-151c-46df-a569-fe9f9c40f557 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:12.201587 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-42a966a1-37d2-4228-be46-daa4c2e5ff69 req-e1e5e909-151c-46df-a569-fe9f9c40f557 service nova] Creating event network-vif-deleted:f9873726-23b4-4ccc-b694-5a56db8cb7db for instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 on hv-cinder-83538 Sep 22 17:16:12.207737 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:12.210849 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-42a966a1-37d2-4228-be46-daa4c2e5ff69 req-e1e5e909-151c-46df-a569-fe9f9c40f557 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049823 Sep 22 17:16:12.211484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 526/1048] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:12.219521 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e4f25a07-7822-4b43-ab51-dcabf6958082 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1614 microversion: 2.1 time: 0.125035 Sep 22 17:16:12.221378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 523/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:12 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1614 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:13.118028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:13.118869 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:13.126588 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:13.127188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:13.127692 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:13.128462 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:13.128928 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:13.129350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:13.244042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:13.244648 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:13.252135 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:13.252704 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:13.253357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:13.254138 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:13.254668 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:13.255203 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:13.274056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:13.282658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5b876df4-d148-4c78-9b17-028c4b811285 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1314 microversion: 2.1 time: 0.169956 Sep 22 17:16:13.283272 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 527/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:13 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:13.288160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:13.288722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:13.289231 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:13.289752 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'fault' on Instance uuid 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:16:13.331296 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:13.339162 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9ee20c4f-8a46-4f5b-a547-4e49c4083a6a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 200 len: 1331 microversion: 2.1 time: 0.099094 Sep 22 17:16:13.339732 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 524/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:13 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:14.306300 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:14.306937 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:14.313748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:14.314235 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:14.314676 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:14.315408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:14.315848 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:14.316351 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:14.364380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:14.365780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:14.372813 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:14.373341 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:14.373768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:14.374470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:14.374988 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:14.375418 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:14.380838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:14.393608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 HTTP/1.1 Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:16:14.396344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:16:14.397829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '8ebb556d-d6b7-4759-8a5d-e6e5eea385b6'} Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:16:14.398700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:16:14.403391 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:14.405198 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:16:14.405198 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a7814483-9fba-4573-a244-8255034f2e8e tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 404 len: 111 microversion: 2.1 time: 0.038632 Sep 22 17:16:14.405198 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 525/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:14 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:16:14.411988 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-475ef296-9104-4cba-bf60-25a7d6258944 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '.version_select at 0x7f51d96a40d0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:14.432853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-475ef296-9104-4cba-bf60-25a7d6258944 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554553393" status: 202 len: 0 microversion: 2.1 time: 0.025590 Sep 22 17:16:14.433426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 526/1053] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 22 17:16:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554553393 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:16:14.539009 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:14.547129 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-275c3b98-f04a-44c7-93d4-5256b9fd3945 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1464 microversion: 2.1 time: 0.244617 Sep 22 17:16:14.547996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 528/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:14 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1464 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:14.596965 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:14.597464 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:14.604598 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:14.605457 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:14.605952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:14.606722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:14.607259 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:14.607750 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:14.637015 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:16:14.708293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:14.735973 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5f52c5ed-67ac-416f-8165-f45837530e59 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 204 len: 0 microversion: 2.1 time: 0.143231 Sep 22 17:16:14.736847 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 527/1055] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:16:14 2022] DELETE /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:16:14.745558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:14.746175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:14.753345 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:14.754104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:14.754709 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:14.755610 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:14.756221 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:14.756797 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:14.776620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:14.902125 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:14.910061 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-fed62f59-7e3c-4487-9208-ff51f1893f93 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1470 microversion: 2.1 time: 0.168617 Sep 22 17:16:14.910640 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 529/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:14 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:16:15.135608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-eed60236-c615-445a-986a-b1ed9f99f582 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: .version_select at 0x7f51d9601d30>, body: {"keypair": {"name": "tempest-keypair-971267443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgRoNyY5mtQNJqVQApy81c++tEUU8O593/S/eU3NffykuyA+N40DTKJgpokyWgUP10s25zx+XQfwyacZMwVKa2XcjEBP/jFU8yv3ftKADGc2jsp/i4dWuPx5LmsaAwiZA=="}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:15.153226 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-eed60236-c615-445a-986a-b1ed9f99f582 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'key_pairs'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:16:15.157098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-eed60236-c615-445a-986a-b1ed9f99f582 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for user 5feea3b3b7e4401ea7db242cb60fdfcc and project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'key_pairs'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:16:15.183607 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-eed60236-c615-445a-986a-b1ed9f99f582 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052272 Sep 22 17:16:15.184253 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 528/1057] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 22 17:16:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:15.933730 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:15.934592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:15.941294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:15.941787 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:15.942223 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:15.942936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:15.943419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:15.943841 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:16.271695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:16.280562 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8fd60cc0-2676-4f2c-b3f5-a1cc85ec3013 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1470 microversion: 2.1 time: 0.350209 Sep 22 17:16:16.281141 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 530/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:15 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1470 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:16.745910 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1862246244", "imageRef": "99e622f0-7e47-4bcf-8cb5-e3e98b293f41", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82eac7a2-877a-48c4-bcb2-cd10274854a5"}], "security_groups": [{"name": "tempest-securitygroup--1082149495"}], "key_name": "tempest-keypair-971267443", "user_data": "}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:16.902822 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] validate_networks() for [('82eac7a2-877a-48c4-bcb2-cd10274854a5', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:16:17.304479 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:17.305316 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:17.312682 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:17.313197 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:17.313850 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:17.314548 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:17.315034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:17.315462 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:17.425490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015a74f1c0194f918e65723d4ec4d904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1443ca94374d4d3e89165346152d76e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:17.438377 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7f5422f4-93df-4db0-93bd-b97719b80c9b tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 200 len: 1428 microversion: 2.1 time: 0.137824 Sep 22 17:16:17.439641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 531/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:17 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 1428 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:16:17.530265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-0449b3af-715e-4dcf-9deb-60f00897f440 req-2f82b4e8-7cc4-4c28-b1f0-fb16b0182d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce5e874-5a0e-4f05-9797-d1792cce3eab", "name": "network-vif-deleted", "tag": "b0e0a1bc-7a19-4c29-bd56-63a6e98c34d3"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:17.545746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-0449b3af-715e-4dcf-9deb-60f00897f440 req-2f82b4e8-7cc4-4c28-b1f0-fb16b0182d69 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:17.546516 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-0449b3af-715e-4dcf-9deb-60f00897f440 req-2f82b4e8-7cc4-4c28-b1f0-fb16b0182d69 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:17.547153 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-0449b3af-715e-4dcf-9deb-60f00897f440 req-2f82b4e8-7cc4-4c28-b1f0-fb16b0182d69 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:17.564403 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-0449b3af-715e-4dcf-9deb-60f00897f440 req-2f82b4e8-7cc4-4c28-b1f0-fb16b0182d69 service nova] Creating event network-vif-deleted:b0e0a1bc-7a19-4c29-bd56-63a6e98c34d3 for instance bce5e874-5a0e-4f05-9797-d1792cce3eab on hv-cinder-83538 Sep 22 17:16:17.568471 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:16:17.568922 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:16:17.569425 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:16:17.569811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:16:17.570226 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:16:17.575845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-0449b3af-715e-4dcf-9deb-60f00897f440 req-2f82b4e8-7cc4-4c28-b1f0-fb16b0182d69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053859 Sep 22 17:16:17.576510 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 532/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:17.581719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:17.582827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:17.583308 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:17.584083 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:17.584541 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:17.584967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:17.616907 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:16:17.622088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Getting quotas for user 5feea3b3b7e4401ea7db242cb60fdfcc and project a6e3ace80a4a43b2b187060d6eca8538. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:16:17.635181 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:16:17.637679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99e622f0-7e47-4bcf-8cb5-e3e98b293f41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:16:17.684864 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d612973d-44ff-4dc9-aa32-5d3f08e86dee tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.943938 Sep 22 17:16:17.685435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 529/1061] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:16:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 17:16:17.697149 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-df74af84-df6b-4c87-bc6a-0a7204dbb1e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:17.697857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-df74af84-df6b-4c87-bc6a-0a7204dbb1e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:17.761703 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-df74af84-df6b-4c87-bc6a-0a7204dbb1e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:17.769917 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-df74af84-df6b-4c87-bc6a-0a7204dbb1e5 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1241 microversion: 2.1 time: 0.076687 Sep 22 17:16:17.770541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 533/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:17 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:18.463898 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:18.465136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] [instance: bce5e874-5a0e-4f05-9797-d1792cce3eab] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:18.471600 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:18.472104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:18.472661 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:18.473435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:18.474125 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:18.474552 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:18.489472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] HTTP exception thrown: Instance bce5e874-5a0e-4f05-9797-d1792cce3eab could not be found. Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Request method failure captured: Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab HTTP/1.1 Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJhOUNuQjtzgIPbd4ZiOsRvQsmMcZPPwc8XhnJViEaH3wjhUGCPzvYekZqJtCnlbVnS3t6oXRdd3GpxIVQUzkrgABg1Pxb934Krbgxt_u6Kb0hlw4NOmVEhbw4usdmZ9cei3M2jdUpcNds4velMgNuOrbGZ5loF5b87ULfQk_-oglRU Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 1443ca94374d4d3e89165346152d76e1 Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-VolumesNegativeTest-1626166791 Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:16:18.491147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1443ca94374d4d3e89165346152d76e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1443ca94374d4d3e89165346152d76e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1443ca94374d4d3e89165346152d76e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1443ca94374d4d3e89165346152d76e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-VolumesNegativeTest-1626166791 Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 1443ca94374d4d3e89165346152d76e1 Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-VolumesNegativeTest-1626166791 Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-VolumesNegativeTest-1626166791-project Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 015a74f1c0194f918e65723d4ec4d904 Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-VolumesNegativeTest-1626166791-project Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance bce5e874-5a0e-4f05-9797-d1792cce3eab could not be found. Sep 22 17:16:18.492730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': 'bce5e874-5a0e-4f05-9797-d1792cce3eab'} Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce5e874-5a0e-4f05-9797-d1792cce3eab could not be found. Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:16:18.493720 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce5e874-5a0e-4f05-9797-d1792cce3eab could not be found. Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce5e874-5a0e-4f05-9797-d1792cce3eab could not be found. Sep 22 17:16:18.495215 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:18.496368 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] Returning 404 to user: Instance bce5e874-5a0e-4f05-9797-d1792cce3eab could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:16:18.496368 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e42f6295-4ec6-45ac-8baa-2749627712a0 tempest-VolumesNegativeTest-1626166791 tempest-VolumesNegativeTest-1626166791-project] 10.222.0.16 "GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab" status: 404 len: 111 microversion: 2.1 time: 0.033968 Sep 22 17:16:18.496368 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 530/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:18 2022] GET /compute/v2.1/servers/bce5e874-5a0e-4f05-9797-d1792cce3eab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:16:18.793116 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:18.793752 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:18.800822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:18.801299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:18.801725 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:18.802432 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:18.803078 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:18.803497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:18.866347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:18.874110 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2e7ee907-bf63-4bd3-858a-53d2514da325 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1293 microversion: 2.1 time: 0.084819 Sep 22 17:16:18.874679 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 534/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:18 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:19.897553 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:19.898874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:19.906448 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:19.907680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:19.908225 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:19.909040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:19.909619 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:19.910171 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:20.089238 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:20.097909 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0a368b15-e7f7-4402-ad6d-098e23724c00 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.204339 Sep 22 17:16:20.110974 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 531/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:19 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:21.010712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-f665000e-ed13-4d3f-b84d-65db9d9a77a7 req-df916000-56fe-48f0-b7cc-69e156bb42eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317daea2-77e2-4c68-b9e3-849b3164d8f2", "tag": "8666e805-fb54-4f7d-baa6-8a55d3805878"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:21.021958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-f665000e-ed13-4d3f-b84d-65db9d9a77a7 req-df916000-56fe-48f0-b7cc-69e156bb42eb service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:21.022793 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-f665000e-ed13-4d3f-b84d-65db9d9a77a7 req-df916000-56fe-48f0-b7cc-69e156bb42eb service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:21.023352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-f665000e-ed13-4d3f-b84d-65db9d9a77a7 req-df916000-56fe-48f0-b7cc-69e156bb42eb service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:21.036551 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-f665000e-ed13-4d3f-b84d-65db9d9a77a7 req-df916000-56fe-48f0-b7cc-69e156bb42eb service nova] Creating event network-changed:8666e805-fb54-4f7d-baa6-8a55d3805878 for instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 on hv-cinder-83538 Sep 22 17:16:21.042059 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-f665000e-ed13-4d3f-b84d-65db9d9a77a7 req-df916000-56fe-48f0-b7cc-69e156bb42eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035875 Sep 22 17:16:21.043210 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 535/1066] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:16:21.122069 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:21.123316 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:21.131546 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:21.132275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:21.132907 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:21.134662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:21.135459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:21.136083 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:21.405736 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:21.414171 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2d3ff091-28fe-42a9-ab72-77b35e52a994 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.296052 Sep 22 17:16:21.414587 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 532/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:21 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:22.440948 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:22.441786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:22.448262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:22.448750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:22.449188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:22.449881 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:22.450338 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:22.450868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:22.601824 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:22.610149 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c7a21b00-4d44-4e78-b8d9-56e96c87bbe1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.175134 Sep 22 17:16:22.610731 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 536/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:22 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:23.633248 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:23.633796 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:23.640232 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:23.640721 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:23.641159 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:23.641851 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:23.642309 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:23.642738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:23.771193 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:23.778867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6b76e50d-ddea-4247-b3fe-b0ae31c1ddd9 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.149683 Sep 22 17:16:23.779460 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 533/1069] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:23 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:24.801299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:24.801921 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:24.808379 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:24.808862 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:24.809299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:24.809982 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:24.810930 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:24.811378 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:24.946143 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:24.954376 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3e95dae4-471e-4a31-93f8-18431e091b4a tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.157324 Sep 22 17:16:24.954936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 537/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:24 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:25.860517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-74b12112-4f5f-4e32-96c1-b9dd3936aab7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:25.861072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-74b12112-4f5f-4e32-96c1-b9dd3936aab7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:25.867435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74b12112-4f5f-4e32-96c1-b9dd3936aab7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:25.867909 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74b12112-4f5f-4e32-96c1-b9dd3936aab7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:25.868337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74b12112-4f5f-4e32-96c1-b9dd3936aab7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:25.869016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74b12112-4f5f-4e32-96c1-b9dd3936aab7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:25.869459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74b12112-4f5f-4e32-96c1-b9dd3936aab7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:25.869874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-74b12112-4f5f-4e32-96c1-b9dd3936aab7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:25.892749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-74b12112-4f5f-4e32-96c1-b9dd3936aab7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/ips" status: 200 len: 151 microversion: 2.20 time: 0.036175 Sep 22 17:16:25.893310 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 534/1071] 10.222.0.16 () {60 vars in 1289 bytes} [Thu Sep 22 17:16:25 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 17:16:25.978671 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:25.979390 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:25.981348 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=54 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:25.987087 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:25.987579 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:25.988014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:25.988712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:25.989159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:25.989584 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:26.131403 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:26.137701 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2b7e2e8d-8a9c-46da-8b71-50a5f4fa5bc1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.163473 Sep 22 17:16:26.138494 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 538/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:25 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:27.161890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:27.162578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:27.169690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:27.170380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:27.171603 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:27.172632 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:27.173145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:27.173627 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:27.321805 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:27.330235 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-30f7f6b0-ac90-4ece-99b8-d7552edf04f4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.172237 Sep 22 17:16:27.330732 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 535/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:27 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:27.935751 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-134821247"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:27.936868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:27.939518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:27.945252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:27.945741 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:27.946174 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:27.946864 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:27.947350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:27.947773 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:28.079526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.network.security_group_api [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Removing security group 29fa356b-5477-44d1-8eab-bec3a18b8ba0 from port 5886ff66-8e7f-4da4-960b-035ee76660f1 Sep 22 17:16:28.265392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:28.265967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:28.267925 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:28.268773 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=10 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:28.275233 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:28.275721 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:28.276173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:28.276875 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:28.277323 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:28.277742 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:28.303190 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lazy-loading 'flavor' on Instance uuid 3946f917-8585-453c-9eff-81ab4ba3b860 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:16:28.410492 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6a55a9ba-ff17-4573-a4a3-5cb530a26095 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "POST /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/action" status: 202 len: 0 microversion: 2.1 time: 0.478674 Sep 22 17:16:28.414150 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 539/1074] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 22 17:16:27 2022] POST /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:16:28.427630 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:28.428242 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:28.442190 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:28.443402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:28.444708 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:28.445657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:28.447003 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:28.447685 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:28.515300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0ada33d0-1f51-4a3e-92ed-13544669a710 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/action" status: 202 len: 0 microversion: 2.20 time: 0.253880 Sep 22 17:16:28.516246 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 536/1075] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 22 17:16:28 2022] POST /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 22 17:16:28.523088 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-0fca34b3-cd8b-424d-9db0-e6ce21544efc req-339feb0d-1d36-4456-a36b-2bd33accba99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b", "tag": "5886ff66-8e7f-4da4-960b-035ee76660f1"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:28.535875 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0fca34b3-cd8b-424d-9db0-e6ce21544efc req-339feb0d-1d36-4456-a36b-2bd33accba99 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:28.536645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0fca34b3-cd8b-424d-9db0-e6ce21544efc req-339feb0d-1d36-4456-a36b-2bd33accba99 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:28.537254 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0fca34b3-cd8b-424d-9db0-e6ce21544efc req-339feb0d-1d36-4456-a36b-2bd33accba99 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:28.553236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-0fca34b3-cd8b-424d-9db0-e6ce21544efc req-339feb0d-1d36-4456-a36b-2bd33accba99 service nova] Creating event network-changed:5886ff66-8e7f-4da4-960b-035ee76660f1 for instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b on hv-cinder-83538 Sep 22 17:16:28.558852 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-0fca34b3-cd8b-424d-9db0-e6ce21544efc req-339feb0d-1d36-4456-a36b-2bd33accba99 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040473 Sep 22 17:16:28.559726 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 537/1076] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:28.566989 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:28.568151 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:28.576110 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:28.576647 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:28.577117 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:28.577853 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:28.578304 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:28.578727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:28.687725 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:28.695904 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cb6c1233-f59f-41c5-b3ee-5b1462960a44 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.283676 Sep 22 17:16:28.696513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 540/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:28 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:28.747158 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:28.755738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:28.757173 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:28.760780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-34c246b1-3bcb-441a-a529-025e5ca89530 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.199416 Sep 22 17:16:28.761889 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 538/1078] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:28 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:29.504889 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:29.505403 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:29.506570 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-de71ac3d-1863-4d42-b8dc-f8de00deec28 req-043e5377-d717-42a0-a192-69a8c3a2a963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b", "tag": "5886ff66-8e7f-4da4-960b-035ee76660f1"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:29.512546 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:29.513037 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:29.513721 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:29.514455 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:29.516062 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:29.516493 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:29.518726 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-de71ac3d-1863-4d42-b8dc-f8de00deec28 req-043e5377-d717-42a0-a192-69a8c3a2a963 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:29.519321 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-de71ac3d-1863-4d42-b8dc-f8de00deec28 req-043e5377-d717-42a0-a192-69a8c3a2a963 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:29.520375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-de71ac3d-1863-4d42-b8dc-f8de00deec28 req-043e5377-d717-42a0-a192-69a8c3a2a963 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:29.533693 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-de71ac3d-1863-4d42-b8dc-f8de00deec28 req-043e5377-d717-42a0-a192-69a8c3a2a963 service nova] Creating event network-changed:5886ff66-8e7f-4da4-960b-035ee76660f1 for instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b on hv-cinder-83538 Sep 22 17:16:29.538899 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-de71ac3d-1863-4d42-b8dc-f8de00deec28 req-043e5377-d717-42a0-a192-69a8c3a2a963 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036279 Sep 22 17:16:29.539776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 539/1079] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:16:29.609025 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lazy-loading 'services' on Instance uuid 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:16:29.702858 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3a227c79-3d6b-4655-9b4f-c3e997295c15 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments/e797a82b-9146-48fe-afe8-e42b65760fde" status: 202 len: 0 microversion: 2.1 time: 0.201456 Sep 22 17:16:29.707348 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 541/1080] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:16:29 2022] DELETE /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments/e797a82b-9146-48fe-afe8-e42b65760fde => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:16:29.715847 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1b0137a8-d575-4337-a837-a3c808afa02b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:29.718725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1b0137a8-d575-4337-a837-a3c808afa02b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:29.732202 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:29.733659 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1b0137a8-d575-4337-a837-a3c808afa02b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:29.734523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1b0137a8-d575-4337-a837-a3c808afa02b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:29.735000 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:29.735623 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1b0137a8-d575-4337-a837-a3c808afa02b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:29.736783 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1b0137a8-d575-4337-a837-a3c808afa02b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:29.737574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1b0137a8-d575-4337-a837-a3c808afa02b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:29.738608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1b0137a8-d575-4337-a837-a3c808afa02b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:29.746558 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:29.747140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:29.747599 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:29.750260 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:29.750750 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:29.751299 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:29.788032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1b0137a8-d575-4337-a837-a3c808afa02b tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078477 Sep 22 17:16:29.791112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 540/1081] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:16:29 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:29.802674 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:29.803656 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:29.811651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:29.812378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:29.812882 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:29.813787 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:29.814466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:29.815102 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:30.049233 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:30.066029 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:30.068136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c4d6432d-c97a-4914-bf5a-33232565b244 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.347697 Sep 22 17:16:30.069150 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 542/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:29 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:30.078079 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-89570d56-d591-45ed-8c8c-4d1deb4d9220 req-1f075f85-e31d-4cba-ab35-5a5e2a9902ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317daea2-77e2-4c68-b9e3-849b3164d8f2", "name": "network-vif-plugged", "status": "completed", "tag": "8666e805-fb54-4f7d-baa6-8a55d3805878"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:30.088800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:30.090544 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:30.095800 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cb2aba4e-da16-4063-8180-a01b767bae22 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.305425 Sep 22 17:16:30.096392 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 541/1083] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:29 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:30.100013 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-89570d56-d591-45ed-8c8c-4d1deb4d9220 req-1f075f85-e31d-4cba-ab35-5a5e2a9902ff service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:30.100488 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-89570d56-d591-45ed-8c8c-4d1deb4d9220 req-1f075f85-e31d-4cba-ab35-5a5e2a9902ff service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:30.100914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-89570d56-d591-45ed-8c8c-4d1deb4d9220 req-1f075f85-e31d-4cba-ab35-5a5e2a9902ff service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:30.122331 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-89570d56-d591-45ed-8c8c-4d1deb4d9220 req-1f075f85-e31d-4cba-ab35-5a5e2a9902ff service nova] Creating event network-vif-plugged:8666e805-fb54-4f7d-baa6-8a55d3805878 for instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 on hv-cinder-83538 Sep 22 17:16:30.127307 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-89570d56-d591-45ed-8c8c-4d1deb4d9220 req-1f075f85-e31d-4cba-ab35-5a5e2a9902ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055587 Sep 22 17:16:30.127907 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 543/1084] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:30.801205 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3b22f2b8-64eb-4ef0-9f38-5068536d08db tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:30.803397 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3b22f2b8-64eb-4ef0-9f38-5068536d08db tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:30.809807 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b22f2b8-64eb-4ef0-9f38-5068536d08db tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:30.810282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b22f2b8-64eb-4ef0-9f38-5068536d08db tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:30.810712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b22f2b8-64eb-4ef0-9f38-5068536d08db tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:30.811935 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b22f2b8-64eb-4ef0-9f38-5068536d08db tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:30.812373 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b22f2b8-64eb-4ef0-9f38-5068536d08db tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:30.812975 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b22f2b8-64eb-4ef0-9f38-5068536d08db tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:30.845679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3b22f2b8-64eb-4ef0-9f38-5068536d08db tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048549 Sep 22 17:16:30.846237 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 542/1085] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:16:30 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:31.093374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:31.094080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:31.100455 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:31.100940 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:31.101376 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:31.102078 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:31.102538 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:31.102986 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:31.121528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:31.122514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:31.129828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:31.130782 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:31.131160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:31.131862 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:31.132313 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:31.132753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:31.300212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:31.309488 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aacc53c9-a0d7-4168-8b27-35d2c2c92fb1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1367 microversion: 2.1 time: 0.220860 Sep 22 17:16:31.310074 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 544/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:31 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:31.324718 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:31.327026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:31.334044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:31.335507 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:31.336661 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fb10193e-1a60-4e8d-a358-33e0f3a8bc34 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.219150 Sep 22 17:16:31.337208 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 543/1087] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:31 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:16:31.858058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-cd8a9ff3-294e-4cee-a1f9-43970e1a1dbb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:31.860249 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-cd8a9ff3-294e-4cee-a1f9-43970e1a1dbb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:31.866193 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd8a9ff3-294e-4cee-a1f9-43970e1a1dbb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:31.866675 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd8a9ff3-294e-4cee-a1f9-43970e1a1dbb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:31.867135 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd8a9ff3-294e-4cee-a1f9-43970e1a1dbb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:31.867819 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd8a9ff3-294e-4cee-a1f9-43970e1a1dbb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:31.868279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd8a9ff3-294e-4cee-a1f9-43970e1a1dbb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:31.868706 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-cd8a9ff3-294e-4cee-a1f9-43970e1a1dbb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:31.897490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-cd8a9ff3-294e-4cee-a1f9-43970e1a1dbb tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043430 Sep 22 17:16:31.898046 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 545/1088] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:16:31 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 17:16:31.909967 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:31.910534 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:31.917536 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:31.918031 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:31.918470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:31.919195 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:31.919653 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:31.920081 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:31.994183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] HTTP exception thrown: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b is not attached to volume e797a82b-9146-48fe-afe8-e42b65760fde Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Request method failure captured: Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: DELETE /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments/e797a82b-9146-48fe-afe8-e42b65760fde HTTP/1.1 Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJd_Ui09WyCU7nZQZ34pAplGoLhM2DbEPQ0lGXxBygv_-6F59A-FQVxC9lmRn7OhXQPc-3ehREUXb9JXoVfMz0sQCUzqJE8rPFhf9LFmm__XCvkifSB1WpQ8mygmezXCZXrUIHLcWwysN_MR1yBnNDcu8jGRApVVF8ksK8vzJkFD0F4 Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 0749b2616b854791aec389d669ef94c8 Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-TestMinimumBasicScenario-1321902393 Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:16:31.996594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0749b2616b854791aec389d669ef94c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0749b2616b854791aec389d669ef94c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0749b2616b854791aec389d669ef94c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0749b2616b854791aec389d669ef94c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-TestMinimumBasicScenario-1321902393 Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 0749b2616b854791aec389d669ef94c8 Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1321902393 Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-TestMinimumBasicScenario-1321902393-project Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: cf878d3df653463caa7767de835dce83 Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-TestMinimumBasicScenario-1321902393-project Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:16:31.998298 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b is not attached to volume e797a82b-9146-48fe-afe8-e42b65760fde Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'server_id': '7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b', 'id': 'e797a82b-9146-48fe-afe8-e42b65760fde'} Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e797a82b-9146-48fe-afe8-e42b65760fde. Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:16:31.999260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b is not attached to volume e797a82b-9146-48fe-afe8-e42b65760fde Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b is not attached to volume e797a82b-9146-48fe-afe8-e42b65760fde Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:32.000833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Returning 404 to user: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b is not attached to volume e797a82b-9146-48fe-afe8-e42b65760fde {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:16:32.002033 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e1d07c5f-3062-456c-9708-19a3e7917c8c tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments/e797a82b-9146-48fe-afe8-e42b65760fde" status: 404 len: 154 microversion: 2.1 time: 0.093314 Sep 22 17:16:32.002033 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 544/1089] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:16:31 2022] DELETE /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b/os-volume_attachments/e797a82b-9146-48fe-afe8-e42b65760fde => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:16:32.333626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:32.334212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:32.340566 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:32.341072 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:32.341498 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:32.342203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:32.342660 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:32.343119 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:32.362218 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:32.362850 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:32.368700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:32.369176 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:32.369604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:32.370287 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:32.370735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:32.371182 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:32.544286 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:32.552811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2c198209-e7cb-47e6-8395-e4931275e257 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1556 microversion: 2.1 time: 0.223228 Sep 22 17:16:32.557792 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 546/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:32 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1556 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:32.558973 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:32.567953 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:32.569409 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:32.570587 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-de524a12-47e5-4d09-8dd3-6bfa9dceef03 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.212694 Sep 22 17:16:32.571160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 545/1091] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:32 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:32.575811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1b451c17-da20-4705-aae3-55ce20d0fda6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:32.576418 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1b451c17-da20-4705-aae3-55ce20d0fda6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:32.582257 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b451c17-da20-4705-aae3-55ce20d0fda6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:32.582735 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b451c17-da20-4705-aae3-55ce20d0fda6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:32.583229 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b451c17-da20-4705-aae3-55ce20d0fda6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:32.583973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b451c17-da20-4705-aae3-55ce20d0fda6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:32.584363 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b451c17-da20-4705-aae3-55ce20d0fda6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:32.584786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1b451c17-da20-4705-aae3-55ce20d0fda6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:32.669135 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1b451c17-da20-4705-aae3-55ce20d0fda6 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097329 Sep 22 17:16:32.669746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 547/1092] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 22 17:16:32 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:16:33.139904 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:33.140501 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:33.147133 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:33.147727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:33.148270 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:33.149237 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:33.149624 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:33.150127 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:33.180021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:16:33.261516 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ae799166-981b-41a8-83f3-adbcdb41d4b4 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 204 len: 0 microversion: 2.1 time: 0.126507 Sep 22 17:16:33.262124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 546/1093] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:16:33 2022] DELETE /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:16:33.271078 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:33.271703 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:33.278012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:33.278504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:33.278992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:33.280319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:33.280775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:33.281469 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:33.425012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:33.432996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6632a5d4-11c0-4422-9089-b59d285825d3 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1552 microversion: 2.1 time: 0.165864 Sep 22 17:16:33.433571 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 548/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:33 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:33.596661 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:33.597472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:33.603638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:33.604142 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:33.604641 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:33.605351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:33.605830 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:33.606257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:33.756335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:33.766496 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:33.767749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:33.769036 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-005ab8cc-37d5-45f4-8883-61cb228a3dd5 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.177348 Sep 22 17:16:33.769900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 547/1095] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:33 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:33.923696 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-e24394ee-2443-452f-9fef-678230078520 req-f10fa36c-c889-4d28-a8b8-96973c7fa6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317daea2-77e2-4c68-b9e3-849b3164d8f2", "tag": "8666e805-fb54-4f7d-baa6-8a55d3805878"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:33.933010 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e24394ee-2443-452f-9fef-678230078520 req-f10fa36c-c889-4d28-a8b8-96973c7fa6a4 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:33.933494 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e24394ee-2443-452f-9fef-678230078520 req-f10fa36c-c889-4d28-a8b8-96973c7fa6a4 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:33.933929 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-e24394ee-2443-452f-9fef-678230078520 req-f10fa36c-c889-4d28-a8b8-96973c7fa6a4 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:33.938271 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:33.947968 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-e24394ee-2443-452f-9fef-678230078520 req-f10fa36c-c889-4d28-a8b8-96973c7fa6a4 service nova] Creating event network-changed:8666e805-fb54-4f7d-baa6-8a55d3805878 for instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 on hv-cinder-83538 Sep 22 17:16:33.954494 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-e24394ee-2443-452f-9fef-678230078520 req-f10fa36c-c889-4d28-a8b8-96973c7fa6a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034733 Sep 22 17:16:33.955136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 549/1096] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:34.456227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:34.457474 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:34.464220 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:34.464702 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:34.465336 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:34.466208 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:34.466655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:34.467811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:34.692774 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:34.701175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-fb954d22-4429-486f-92a7-8ed6e77a4ca9 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1552 microversion: 2.1 time: 0.248771 Sep 22 17:16:34.701935 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 548/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:34 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1552 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:34.795253 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:34.796144 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:34.805353 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:34.805836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:34.806265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:34.806980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:34.807441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:34.807854 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:35.057526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:35.066580 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:35.068045 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:35.069496 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-33bf8ac2-babd-4a84-9aee-2ceba4aeea28 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.279395 Sep 22 17:16:35.070123 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 550/1098] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:34 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:35.724290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:35.724928 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:35.731828 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:35.732313 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:35.733239 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:35.733932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:35.734385 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:35.734808 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:36.008364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:36.008865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:36.018226 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:36.019438 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:36.020049 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:36.021146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:36.021922 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:36.022363 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:36.024786 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:36.035742 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e18a5640-2794-462f-852e-7709f3eb8487 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1552 microversion: 2.1 time: 0.313847 Sep 22 17:16:36.053220 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 549/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:35 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1552 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:36.059659 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-38fec214-ce7a-4c6c-b579-f798101703e7 req-80dc918e-5572-44da-9934-6d63f7a2e62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e671ca-5873-4190-9048-a875393d1055", "tag": "bfa945c1-4510-4653-9180-db1133adbc18"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:36.061993 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:16:36.071883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-38fec214-ce7a-4c6c-b579-f798101703e7 req-80dc918e-5572-44da-9934-6d63f7a2e62e service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:36.072414 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-38fec214-ce7a-4c6c-b579-f798101703e7 req-80dc918e-5572-44da-9934-6d63f7a2e62e service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:36.073023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-38fec214-ce7a-4c6c-b579-f798101703e7 req-80dc918e-5572-44da-9934-6d63f7a2e62e service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:36.086917 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-38fec214-ce7a-4c6c-b579-f798101703e7 req-80dc918e-5572-44da-9934-6d63f7a2e62e service nova] Creating event network-changed:bfa945c1-4510-4653-9180-db1133adbc18 for instance 60e671ca-5873-4190-9048-a875393d1055 on hv-cinder-83538 Sep 22 17:16:36.092441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-38fec214-ce7a-4c6c-b579-f798101703e7 req-80dc918e-5572-44da-9934-6d63f7a2e62e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037629 Sep 22 17:16:36.093376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 550/1100] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:36.100055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:36.101662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:36.109404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:36.110204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:36.110643 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:36.111397 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:36.111862 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:36.112293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:36.178914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-ef47a439-df13-4f58-9aa9-8f6b43561cdf tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 204 len: 0 microversion: 2.1 time: 0.174223 Sep 22 17:16:36.180246 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 551/1101] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:16:36 2022] DELETE /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 17:16:36.202641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:36.203694 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:36.211070 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:36.211670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:36.212102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:36.212797 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:36.213241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:36.213657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:36.440256 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:36.449352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:36.451100 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:36.453337 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-dab4b234-f8b6-472b-b3f0-8cc77dd26ed9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.358511 Sep 22 17:16:36.454065 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 551/1102] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:36 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:36.458582 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:36.473170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b7557905-55ff-4073-a7b0-a94a3d8adf23 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.288131 Sep 22 17:16:36.474117 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 552/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:36 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:37.060383 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:37.062080 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:37.069332 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:37.069829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:37.070261 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:37.071206 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:37.071465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:37.071898 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:37.149539 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:37.157574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-49cf193e-c0ef-4ac7-9b18-e189df9e7a38 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1510 microversion: 2.1 time: 0.101074 Sep 22 17:16:37.158150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 552/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:37 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:37.479496 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:37.480111 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:37.489520 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:37.490018 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:37.490457 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:37.491200 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:37.491656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:37.492085 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:37.505981 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:37.506585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:37.512513 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:37.513272 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:37.513934 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:37.514831 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:37.515521 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:37.516145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:37.700067 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:37.708256 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:37.709627 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:37.710794 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7a8b4693-4d7e-4fe2-b352-18ad3ae2f15c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.235546 Sep 22 17:16:37.711408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 553/1105] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:37 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:37.718990 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:37.727778 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0d221fdc-902d-4618-bfee-724629a12a01 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1568 microversion: 2.1 time: 0.225523 Sep 22 17:16:37.728380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 553/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:37 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:16:38.107535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-b98960b5-03fe-4407-81ff-9c5b192551b2 req-e1ccbc17-6a33-4067-8a47-56877152b48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b", "name": "network-vif-deleted", "tag": "5886ff66-8e7f-4da4-960b-035ee76660f1"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:38.117081 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b98960b5-03fe-4407-81ff-9c5b192551b2 req-e1ccbc17-6a33-4067-8a47-56877152b48d service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:38.117574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b98960b5-03fe-4407-81ff-9c5b192551b2 req-e1ccbc17-6a33-4067-8a47-56877152b48d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:38.118186 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b98960b5-03fe-4407-81ff-9c5b192551b2 req-e1ccbc17-6a33-4067-8a47-56877152b48d service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:38.129436 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-b98960b5-03fe-4407-81ff-9c5b192551b2 req-e1ccbc17-6a33-4067-8a47-56877152b48d service nova] Creating event network-vif-deleted:5886ff66-8e7f-4da4-960b-035ee76660f1 for instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b on hv-cinder-83538 Sep 22 17:16:38.134134 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-b98960b5-03fe-4407-81ff-9c5b192551b2 req-e1ccbc17-6a33-4067-8a47-56877152b48d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030342 Sep 22 17:16:38.134711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 554/1107] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:38.181542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:38.182176 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:38.198859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:38.202219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:38.202219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:38.202219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:38.202219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:38.202694 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:38.238651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:38.239187 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:38.239625 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:38.240077 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lazy-loading 'fault' on Instance uuid 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:16:38.312295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf878d3df653463caa7767de835dce83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0749b2616b854791aec389d669ef94c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:38.320065 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7ca27ccf-9fa6-4928-b0af-72ce7e0c4c51 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 200 len: 1347 microversion: 2.1 time: 0.142447 Sep 22 17:16:38.320640 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 554/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:38 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 1347 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:38.737971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:38.738667 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:38.745095 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:38.745579 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:38.746011 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:38.746880 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:38.747510 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:38.748195 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:38.752589 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:38.753324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:38.762191 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:38.762789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:38.763263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:38.764163 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:38.764616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:38.765374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:38.848427 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:38.856798 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ccb6ff0b-a110-4044-96e5-ee2c1d530a8c tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1219 microversion: 2.1 time: 0.109440 Sep 22 17:16:38.857191 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 555/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:38 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:16:38.908835 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:38.917008 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:38.918393 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:38.919586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-d39431a8-c806-4de7-8b7c-808f380f083e tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.187091 Sep 22 17:16:38.920205 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 555/1110] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:38 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:39.344492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:39.345114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] [instance: 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:39.351943 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:39.352435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:39.352884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:39.353587 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:39.354042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:39.354471 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:39.368608 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] HTTP exception thrown: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b could not be found. Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Request method failure captured: Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b HTTP/1.1 Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJd_Ui09WyCU7nZQZ34pAplGoLhM2DbEPQ0lGXxBygv_-6F59A-FQVxC9lmRn7OhXQPc-3ehREUXb9JXoVfMz0sQCUzqJE8rPFhf9LFmm__XCvkifSB1WpQ8mygmezXCZXrUIHLcWwysN_MR1yBnNDcu8jGRApVVF8ksK8vzJkFD0F4 Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 0749b2616b854791aec389d669ef94c8 Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-TestMinimumBasicScenario-1321902393 Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:16:39.370258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0749b2616b854791aec389d669ef94c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0749b2616b854791aec389d669ef94c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0749b2616b854791aec389d669ef94c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0749b2616b854791aec389d669ef94c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-TestMinimumBasicScenario-1321902393 Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 0749b2616b854791aec389d669ef94c8 Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1321902393 Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-TestMinimumBasicScenario-1321902393-project Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: cf878d3df653463caa7767de835dce83 Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-TestMinimumBasicScenario-1321902393-project Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b could not be found. Sep 22 17:16:39.372056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b'} Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b could not be found. Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:16:39.376111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b could not be found. Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b could not be found. Sep 22 17:16:39.377677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:16:39.379009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Returning 404 to user: Instance 7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:16:39.379009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e67d5a34-0908-4cd8-8612-aac7f0686482 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b" status: 404 len: 111 microversion: 2.1 time: 0.031996 Sep 22 17:16:39.379009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 556/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:39 2022] GET /compute/v2.1/servers/7ec19d77-8bdd-482c-abf9-d4b64f8c7e0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:16:39.380579 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f740dde7-7426-4b81-9a39-99ce5f0bff71 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] Calling method '.version_select at 0x7f51d97118b0>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:39.400195 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f740dde7-7426-4b81-9a39-99ce5f0bff71 tempest-TestMinimumBasicScenario-1321902393 tempest-TestMinimumBasicScenario-1321902393-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-33544653" status: 202 len: 0 microversion: 2.1 time: 0.023464 Sep 22 17:16:39.400857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 556/1112] 10.222.0.16 () {58 vars in 1266 bytes} [Thu Sep 22 17:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-33544653 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:16:39.879883 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:39.880493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:39.886623 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:39.887146 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:39.887576 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:39.888274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:39.888722 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:39.889686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:39.916831 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:39.922662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:39.923895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:39.924443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:39.924983 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lazy-loading 'fault' on Instance uuid 60e671ca-5873-4190-9048-a875393d1055 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:16:39.946012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:39.947264 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:39.953948 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:39.954423 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:39.954879 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:39.955586 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:39.956036 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:39.956458 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:39.973620 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0365ab1bcfd54946b0b92f8fe9697128', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ed7377d32844bbf95f995831bc21d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:39.981404 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-6ee19d95-21e9-4765-9da2-44e0d5501020 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 200 len: 1224 microversion: 2.1 time: 0.105278 Sep 22 17:16:39.993012 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 557/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:39 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:16:40.119577 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:40.129728 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:40.131462 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:40.132668 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8448b254-6684-460e-a316-f54ed86776a4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.191053 Sep 22 17:16:40.133201 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 557/1114] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:39 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:16:40.150247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-c9d0f042-54de-4c6a-84bc-17f281de51e4 req-ae31b7e9-70d4-4f40-85c8-ba9d330b212b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e671ca-5873-4190-9048-a875393d1055", "name": "network-vif-deleted", "tag": "bfa945c1-4510-4653-9180-db1133adbc18"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:40.160286 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c9d0f042-54de-4c6a-84bc-17f281de51e4 req-ae31b7e9-70d4-4f40-85c8-ba9d330b212b service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:40.160951 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c9d0f042-54de-4c6a-84bc-17f281de51e4 req-ae31b7e9-70d4-4f40-85c8-ba9d330b212b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:40.161643 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-c9d0f042-54de-4c6a-84bc-17f281de51e4 req-ae31b7e9-70d4-4f40-85c8-ba9d330b212b service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:40.177082 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-c9d0f042-54de-4c6a-84bc-17f281de51e4 req-ae31b7e9-70d4-4f40-85c8-ba9d330b212b service nova] Creating event network-vif-deleted:bfa945c1-4510-4653-9180-db1133adbc18 for instance 60e671ca-5873-4190-9048-a875393d1055 on hv-cinder-83538 Sep 22 17:16:40.182551 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-c9d0f042-54de-4c6a-84bc-17f281de51e4 req-ae31b7e9-70d4-4f40-85c8-ba9d330b212b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035765 Sep 22 17:16:40.183495 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 558/1115] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:41.024170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:41.024772 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] [instance: 60e671ca-5873-4190-9048-a875393d1055] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:41.032156 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:41.032808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:41.033253 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:41.033952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:41.034574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:41.035028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:41.049611 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] HTTP exception thrown: Instance 60e671ca-5873-4190-9048-a875393d1055 could not be found. Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Request method failure captured: Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 HTTP/1.1 Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJa12YlD11iGmsiDRy2eMvFw_mYkfbPkujRdHyUn74kL1vAQ93kTbZd-ZuAgNCkI5lM3wLwbu0YxIcR4VWAMOotWSf36ofDoHOsT2yH5FndqsUJ0uOoEoGdEiSLvwKmeW_cQKobTUfQfKNAmiWJ0-XWPfkKrEIi6k9KRPqdcj3w63Wg Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 1ed7377d32844bbf95f995831bc21d6b Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-TestShelveInstance-1629865433 Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:16:41.051387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ed7377d32844bbf95f995831bc21d6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ed7377d32844bbf95f995831bc21d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ed7377d32844bbf95f995831bc21d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ed7377d32844bbf95f995831bc21d6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-TestShelveInstance-1629865433 Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 1ed7377d32844bbf95f995831bc21d6b Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-TestShelveInstance-1629865433 Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-TestShelveInstance-1629865433-project Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: 0365ab1bcfd54946b0b92f8fe9697128 Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-TestShelveInstance-1629865433-project Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 60e671ca-5873-4190-9048-a875393d1055 could not be found. Sep 22 17:16:41.052952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '60e671ca-5873-4190-9048-a875393d1055'} Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e671ca-5873-4190-9048-a875393d1055 could not be found. Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:16:41.053887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e671ca-5873-4190-9048-a875393d1055 could not be found. Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e671ca-5873-4190-9048-a875393d1055 could not be found. Sep 22 17:16:41.055349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:16:41.056845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Returning 404 to user: Instance 60e671ca-5873-4190-9048-a875393d1055 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:16:41.056845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-eb743253-9f5f-4af8-970e-27a219b33942 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055" status: 404 len: 111 microversion: 2.1 time: 0.032817 Sep 22 17:16:41.065318 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 558/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:16:41 2022] GET /compute/v2.1/servers/60e671ca-5873-4190-9048-a875393d1055 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:16:41.162394 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:41.163761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:41.171018 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:41.171802 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:41.172662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:41.173602 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:41.174276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:41.174867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:41.250396 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bb858b6d-467c-41c6-b4fe-fed452424611 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] Calling method '.version_select at 0x7f51d9704160>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:41.280006 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bb858b6d-467c-41c6-b4fe-fed452424611 tempest-TestShelveInstance-1629865433 tempest-TestShelveInstance-1629865433-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-385474825" status: 202 len: 0 microversion: 2.1 time: 0.034003 Sep 22 17:16:41.281184 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 559/1117] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 22 17:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-385474825 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:16:41.348364 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:41.357880 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:41.359787 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:41.361206 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-e2152d67-cc3f-45d4-b792-290c7520ea04 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1744 microversion: 2.20 time: 0.203258 Sep 22 17:16:41.362027 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 559/1118] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:41 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:42.389422 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:42.390036 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:42.406168 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:42.407061 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:42.407744 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:42.408677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:42.409607 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:42.410245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:42.949352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:42.962615 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:42.964146 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:42.965391 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-40b24d0c-b6e1-4405-a879-fd7594b63094 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1744 microversion: 2.20 time: 0.581031 Sep 22 17:16:42.966204 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 560/1119] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:42 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1744 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:43.995374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:43.996684 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:44.005594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:44.006712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:44.007414 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:44.008492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:44.009403 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:44.010042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:44.015919 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:44.270621 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:44.280918 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:44.282858 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:44.284150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5387d2a4-6f1a-4e3a-b7fd-2f6cfa522184 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1744 microversion: 2.20 time: 0.292665 Sep 22 17:16:44.285667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 560/1120] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:43 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1744 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:45.314684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:45.316608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:45.325409 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:45.326445 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:45.327109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:45.331800 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:45.332501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:45.333099 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:45.701399 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:45.723511 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:45.730701 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:45.736359 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-07a630f9-546c-4f9e-a584-dff7994134b3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1744 microversion: 2.20 time: 0.427733 Sep 22 17:16:45.737980 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 561/1121] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:45 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1744 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:45.918684 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-b1b642ad-12c7-4469-b844-60354dc4d4e2 req-25a323f3-b17e-4edf-9926-19b69acc2680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3946f917-8585-453c-9eff-81ab4ba3b860", "name": "network-vif-plugged", "status": "completed", "tag": "53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:45.930631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-b1b642ad-12c7-4469-b844-60354dc4d4e2 req-25a323f3-b17e-4edf-9926-19b69acc2680 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:45.931194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-b1b642ad-12c7-4469-b844-60354dc4d4e2 req-25a323f3-b17e-4edf-9926-19b69acc2680 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:45.931660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-b1b642ad-12c7-4469-b844-60354dc4d4e2 req-25a323f3-b17e-4edf-9926-19b69acc2680 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:45.944753 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-b1b642ad-12c7-4469-b844-60354dc4d4e2 req-25a323f3-b17e-4edf-9926-19b69acc2680 service nova] Creating event network-vif-plugged:53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7 for instance 3946f917-8585-453c-9eff-81ab4ba3b860 on hv-cinder-83538 Sep 22 17:16:45.950116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-b1b642ad-12c7-4469-b844-60354dc4d4e2 req-25a323f3-b17e-4edf-9926-19b69acc2680 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035714 Sep 22 17:16:45.950731 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 561/1122] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:46.766600 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:46.767349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:46.773778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:46.774272 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:46.774684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:46.775413 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:46.775854 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:46.776447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:47.117649 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:47.137350 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:47.139243 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:47.141038 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a05f9982-2006-4499-864a-c553f913b52a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.380617 Sep 22 17:16:47.156457 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 562/1123] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:46 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:48.178693 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:48.179945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:48.196051 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:48.197955 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:48.198422 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:48.203335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:48.207544 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:48.208229 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:48.526612 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:48.536811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:48.542334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:48.544249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-63cfee76-0c3c-42f1-a78d-503284df293a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.375189 Sep 22 17:16:48.548483 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 562/1124] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:48 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:49.575002 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:49.576323 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:49.587950 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:49.588690 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:49.589296 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:49.590213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:49.590833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:49.591439 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:49.983961 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:50.005692 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:50.007313 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:50.011498 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-1ce478dc-4494-4300-af41-85780f095af9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.442036 Sep 22 17:16:50.023620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 563/1125] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:49 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:51.043098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:51.045386 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:51.056793 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:51.058463 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:51.059033 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:51.059775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:51.060234 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:51.061213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:51.260199 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:51.270679 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:51.272821 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:51.275677 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f20957da-3a07-483c-a7bb-3b8c0ede82f4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.237260 Sep 22 17:16:51.291884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 563/1126] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:51 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:52.304959 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:52.305601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:52.313489 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:52.314181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:52.314753 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:52.315652 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:52.316253 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:52.316826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:52.523761 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:52.545645 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:52.547984 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:52.549268 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bfdd7a3a-2f47-476c-a9f7-8e9c694d5a49 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.248275 Sep 22 17:16:52.575768 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 564/1127] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:52 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:53.575263 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:53.576029 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:53.582712 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:53.583525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:53.583963 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:53.584826 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:53.585276 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:53.585700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:53.726389 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:53.735798 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:53.737541 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:53.738717 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3b94efbe-4e32-412d-ab54-0873553b1343 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.167494 Sep 22 17:16:53.739525 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 564/1128] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:53 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:54.765110 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:54.769172 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:54.776210 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:54.776775 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:54.777281 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:54.778042 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:54.778562 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:54.779082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:54.923755 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:54.932736 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:54.935130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:54.936364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5bb64086-ecd7-4446-b2b5-e2beb67a5cad tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.175237 Sep 22 17:16:54.951636 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 565/1129] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:54 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:55.961981 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:55.962593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:55.970716 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:55.971257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:55.972187 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:55.973443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:55.974108 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:55.974548 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:56.119567 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:56.128398 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:56.129838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:56.131164 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a5b3a8df-4ad7-4f77-abb5-ddb1e263ced3 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.173169 Sep 22 17:16:56.131624 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 565/1130] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:55 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:57.163592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:57.164490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:57.166710 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:57.172447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:57.173321 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:57.173751 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:57.174608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:57.175189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:57.175763 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:57.332057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:57.341289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:57.342792 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:57.344289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8487c743-8aef-4257-8fc4-dff3bbe53bf4 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.184597 Sep 22 17:16:57.344866 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 566/1131] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:57 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:16:57.576809 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-50b9b770-4368-43f2-b598-ad6e4004849b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:57.591282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-50b9b770-4368-43f2-b598-ad6e4004849b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:57.600903 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-50b9b770-4368-43f2-b598-ad6e4004849b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:57.601658 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-50b9b770-4368-43f2-b598-ad6e4004849b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:57.602344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-50b9b770-4368-43f2-b598-ad6e4004849b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:57.603355 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-50b9b770-4368-43f2-b598-ad6e4004849b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:57.604066 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-50b9b770-4368-43f2-b598-ad6e4004849b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:57.604760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-50b9b770-4368-43f2-b598-ad6e4004849b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:57.630745 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-50b9b770-4368-43f2-b598-ad6e4004849b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/ips" status: 200 len: 145 microversion: 2.1 time: 0.057798 Sep 22 17:16:57.631702 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 566/1132] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:16:57 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/ips => generated 145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:58.370188 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:58.370820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:58.378100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:58.378635 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:58.379042 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:58.379725 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:58.380175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:58.380591 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:58.509931 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:58.518707 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:58.520183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:58.521343 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-bea5bea1-4406-452f-b9d0-e4ea9f3582f0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1739 microversion: 2.20 time: 0.155126 Sep 22 17:16:58.521888 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 567/1133] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:58 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:16:59.008741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-41dec730-0c72-41b4-8969-f8222b988e38 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e2c90ca-0ba4-4108-8455-28b382aa9b68"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:16:59.011130 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-41dec730-0c72-41b4-8969-f8222b988e38 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:59.018035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41dec730-0c72-41b4-8969-f8222b988e38 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:59.018449 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41dec730-0c72-41b4-8969-f8222b988e38 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:59.018974 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41dec730-0c72-41b4-8969-f8222b988e38 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:59.019741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41dec730-0c72-41b4-8969-f8222b988e38 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:59.020233 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41dec730-0c72-41b4-8969-f8222b988e38 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:59.020713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41dec730-0c72-41b4-8969-f8222b988e38 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:59.295635 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-41dec730-0c72-41b4-8969-f8222b988e38 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290028 Sep 22 17:16:59.296267 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 567/1134] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:16:59 2022] POST /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:16:59.547597 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:16:59.548574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:16:59.555039 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:59.555629 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:59.556118 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:59.556905 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:16:59.557426 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:16:59.557976 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:16:59.562491 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:16:59.705846 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:59.713958 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:59.715513 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:16:59.717343 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-70da69e6-9ed0-45f4-94f2-bd94983b888c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1721 microversion: 2.20 time: 0.173568 Sep 22 17:16:59.717904 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 568/1135] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:16:59 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:00.743348 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:00.744047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:00.750281 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:00.750763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:00.751227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:00.751916 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:00.752368 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:00.752789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:00.883555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:00.891647 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:00.893078 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:00.894267 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9f9f91fc-f9a9-41ab-adb3-79e1d41e0cbb tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1721 microversion: 2.20 time: 0.155720 Sep 22 17:17:00.894818 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 568/1136] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:00 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:01.924329 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:01.924976 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:01.932062 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:01.932633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:01.933172 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:01.933994 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:01.934528 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:01.934974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:02.069773 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:02.078149 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:02.079626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:02.080808 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-86fc10bc-f4c7-4419-93f0-01fc0af0ba1f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1664 microversion: 2.20 time: 0.161330 Sep 22 17:17:02.081367 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 569/1137] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:01 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:02.105615 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-41446a8c-f01d-46d2-a1b7-4b0b10bc2f0b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4376a96c-daf1-47f5-a624-e80601fe2b76"}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:17:02.108798 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-41446a8c-f01d-46d2-a1b7-4b0b10bc2f0b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:02.115112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41446a8c-f01d-46d2-a1b7-4b0b10bc2f0b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:02.115584 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41446a8c-f01d-46d2-a1b7-4b0b10bc2f0b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:02.116011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41446a8c-f01d-46d2-a1b7-4b0b10bc2f0b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:02.116689 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41446a8c-f01d-46d2-a1b7-4b0b10bc2f0b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:02.117127 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41446a8c-f01d-46d2-a1b7-4b0b10bc2f0b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:02.117542 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-41446a8c-f01d-46d2-a1b7-4b0b10bc2f0b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:02.412907 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-41446a8c-f01d-46d2-a1b7-4b0b10bc2f0b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311131 Sep 22 17:17:02.413540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 569/1138] 10.222.0.16 () {62 vars in 1364 bytes} [Thu Sep 22 17:17:02 2022] POST /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 17:17:02.559680 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e248df95-954c-4690-b992-88959ffb505c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:02.560181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e248df95-954c-4690-b992-88959ffb505c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:02.566651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e248df95-954c-4690-b992-88959ffb505c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:02.567186 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e248df95-954c-4690-b992-88959ffb505c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:02.567641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e248df95-954c-4690-b992-88959ffb505c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:02.568349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e248df95-954c-4690-b992-88959ffb505c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:02.568811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e248df95-954c-4690-b992-88959ffb505c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:02.569234 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e248df95-954c-4690-b992-88959ffb505c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:02.823578 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e248df95-954c-4690-b992-88959ffb505c tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/os-volume_attachments/4376a96c-daf1-47f5-a624-e80601fe2b76" status: 202 len: 0 microversion: 2.20 time: 0.267226 Sep 22 17:17:02.823884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 570/1139] 10.222.0.16 () {60 vars in 1457 bytes} [Thu Sep 22 17:17:02 2022] DELETE /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/os-volume_attachments/4376a96c-daf1-47f5-a624-e80601fe2b76 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:17:02.895191 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:17:02.895794 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:02.904251 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:02.905049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:02.905498 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:02.906204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:02.906660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:02.907113 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:02.954940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120804) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 17:17:03.023936 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-14f04d4a-bc47-406b-97df-479e9c679373 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "POST /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/action" status: 202 len: 0 microversion: 2.20 time: 0.132891 Sep 22 17:17:03.024560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 570/1140] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 22 17:17:02 2022] POST /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:17:03.032738 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:03.033501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:03.039822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:03.040313 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:03.040736 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:03.041608 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:03.042256 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:03.042633 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:03.403507 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-1961a2fc-5c9e-479c-99dd-7636a5f177f9 req-d7035300-2ef6-4d85-b54f-ff89f2f6bc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3946f917-8585-453c-9eff-81ab4ba3b860", "name": "network-vif-unplugged", "status": "completed", "tag": "53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:17:03.419807 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-1961a2fc-5c9e-479c-99dd-7636a5f177f9 req-d7035300-2ef6-4d85-b54f-ff89f2f6bc1f service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:03.422236 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-1961a2fc-5c9e-479c-99dd-7636a5f177f9 req-d7035300-2ef6-4d85-b54f-ff89f2f6bc1f service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:03.423140 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-1961a2fc-5c9e-479c-99dd-7636a5f177f9 req-d7035300-2ef6-4d85-b54f-ff89f2f6bc1f service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:03.439979 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.compute.server_external_events [req-1961a2fc-5c9e-479c-99dd-7636a5f177f9 req-d7035300-2ef6-4d85-b54f-ff89f2f6bc1f service nova] Unable to find a host for instance 3946f917-8585-453c-9eff-81ab4ba3b860. Dropping event network-vif-unplugged {{(pid=120804) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 22 17:17:03.441734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-1961a2fc-5c9e-479c-99dd-7636a5f177f9 req-d7035300-2ef6-4d85-b54f-ff89f2f6bc1f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043129 Sep 22 17:17:03.443302 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 571/1141] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 22 17:17:03.449606 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:03.459880 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:03.461347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:03.462693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f79a070b-bebc-4509-addc-7643fc2de674 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1672 microversion: 2.20 time: 0.433893 Sep 22 17:17:03.463326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 571/1142] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:03 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1672 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:04.488219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:04.488876 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:04.495982 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:04.496477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:04.496917 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:04.497640 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:04.498749 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:04.499221 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:04.725010 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:04.734096 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:04.735598 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:04.736859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-61206e3c-f9a5-40bd-9bfb-69e9486cdbcc tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.252674 Sep 22 17:17:04.737376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 572/1143] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:04 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:05.769245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:05.771128 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:05.786509 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:05.787349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:05.787976 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:05.788852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:05.789485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:05.790063 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:05.943017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:05.952085 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:05.953557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:05.954939 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2d08fd5f-0dec-4a5e-991a-a5edde03a24b tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.196020 Sep 22 17:17:05.955549 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 572/1144] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:05 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:06.981111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:06.981728 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:06.989877 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:06.990374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:06.990810 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:06.991562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:06.992021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:06.992499 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:07.016842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:17:07.264860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:07.275007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:07.276477 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:07.277658 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cda50dd1-0719-4fdd-886d-a08759f6085a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.300605 Sep 22 17:17:07.278214 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 573/1145] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:06 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:08.308885 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:08.310973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:08.331355 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:08.337022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:08.337848 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:08.339124 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:08.340876 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:08.342393 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:08.576610 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:08.593361 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:08.596390 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:08.598670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8e6a3496-38ce-4dc1-acce-6a37e243d384 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.297050 Sep 22 17:17:08.599767 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 573/1146] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:08 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:09.624126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:09.624732 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:09.631424 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:09.631907 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:09.632340 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:09.633032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:09.633508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:09.634060 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:09.778453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:09.788011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:09.789541 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:09.790861 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-61a7cbba-7a50-4e2f-9c0c-cca29e5b1209 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.170495 Sep 22 17:17:09.791781 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 574/1147] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:09 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:10.819949 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:10.820697 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:10.827615 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:10.828102 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:10.828532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:10.829241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:10.829691 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:10.830112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:10.999577 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:11.007845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:11.009290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:11.010460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-4bb4cfb9-dc8f-427b-bbbb-39430c4cf3cd tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.195343 Sep 22 17:17:11.011046 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 574/1148] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:10 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:12.036801 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:12.037334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:12.039759 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:17:12.045877 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:12.046365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:12.046806 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:12.047574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:12.048274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:12.048715 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:12.196441 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:12.219924 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:12.222411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:12.224007 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c1d57951-97c4-4d7f-a84e-a039b39660a7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.191217 Sep 22 17:17:12.224585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 575/1149] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:12 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:13.255853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:13.259916 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:13.267978 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:13.268475 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:13.268912 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:13.269631 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:13.270318 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:13.270751 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:13.427032 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:13.436641 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:13.438429 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:13.439812 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5a0fb05e-86e4-492f-9d2c-0a22afa9d294 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.189555 Sep 22 17:17:13.440453 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 575/1150] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:13 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:17:14.467295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:14.469514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:14.477209 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:14.477699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:14.478139 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:14.478852 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:14.479339 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:14.479765 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:14.634624 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:14.643860 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:14.645351 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:14.646546 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-678f4485-48d9-456e-af2c-caebfb24bc66 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.184294 Sep 22 17:17:14.647136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 576/1151] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:14 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:15.673393 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:15.674056 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:15.680113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:15.680501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:15.680933 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:15.681631 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:15.682100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:15.682504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:15.825689 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:15.833960 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:15.835452 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:15.836635 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-785685a0-3cf9-4080-9a6f-890b9cd241b9 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.168221 Sep 22 17:17:15.837203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 576/1152] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:15 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:16.865085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:16.865724 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:16.872194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:16.872690 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:16.873129 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:16.873923 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:16.874866 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:16.875315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:17.016952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:17.025251 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:17.026723 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:17.027945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3b2cc854-cd3c-4a24-bd18-7daf17238f99 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.166847 Sep 22 17:17:17.028523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 577/1153] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:16 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:18.054080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:18.054778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:18.062262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:18.062747 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:18.063276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:18.063971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:18.064437 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:18.064856 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:18.206507 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:18.215024 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:18.216492 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:18.217678 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-aee71567-4d8d-477e-a715-8b3f66a0e65d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.167578 Sep 22 17:17:18.218259 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 577/1154] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:18 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:19.244602 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:19.245257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:19.252220 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:19.252765 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:19.253248 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:19.254002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:19.254505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:19.255003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:19.409334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:19.417682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:19.419177 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:19.420365 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0852c470-1282-49cc-b992-340b9a6c49af tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.180116 Sep 22 17:17:19.421118 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 578/1155] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:19 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:20.452791 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:20.453883 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:20.464869 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:20.465684 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:20.466419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:20.467289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:20.468556 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:20.469152 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:20.605206 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:20.616533 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:20.618022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:20.619252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3bd223e7-85f3-4985-a55b-6094fe39aaae tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.173984 Sep 22 17:17:20.619822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 578/1156] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:20 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:21.656267 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:21.656865 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:21.663850 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:21.664358 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:21.664786 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:21.665472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:21.665912 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:21.666328 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:21.809433 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:21.818613 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:21.820120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:21.821352 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2883e8ec-3393-4cd7-b1da-97ccad01a347 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.169509 Sep 22 17:17:21.827044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 579/1157] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:21 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:22.849215 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:22.849861 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:22.857734 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:22.858785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:22.859270 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:22.859995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:22.860628 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:22.861172 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:22.907742 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-df6320f5-6f6a-4a26-acca-ad24dec20d53 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:22.910105 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-df6320f5-6f6a-4a26-acca-ad24dec20d53 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:22.917104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-df6320f5-6f6a-4a26-acca-ad24dec20d53 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:22.917585 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-df6320f5-6f6a-4a26-acca-ad24dec20d53 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:22.918014 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-df6320f5-6f6a-4a26-acca-ad24dec20d53 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:22.918719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-df6320f5-6f6a-4a26-acca-ad24dec20d53 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:22.919213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-df6320f5-6f6a-4a26-acca-ad24dec20d53 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:22.919638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-df6320f5-6f6a-4a26-acca-ad24dec20d53 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:22.952772 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-df6320f5-6f6a-4a26-acca-ad24dec20d53 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049645 Sep 22 17:17:22.953354 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 580/1158] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:17:22 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:17:22.964175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b86a6025-de54-4da2-82ca-1e2beeaa4423 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:22.964664 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b86a6025-de54-4da2-82ca-1e2beeaa4423 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:22.970874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b86a6025-de54-4da2-82ca-1e2beeaa4423 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:22.971411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b86a6025-de54-4da2-82ca-1e2beeaa4423 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:22.971843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b86a6025-de54-4da2-82ca-1e2beeaa4423 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:22.972549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b86a6025-de54-4da2-82ca-1e2beeaa4423 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:22.973003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b86a6025-de54-4da2-82ca-1e2beeaa4423 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:22.973417 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b86a6025-de54-4da2-82ca-1e2beeaa4423 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:23.005867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b86a6025-de54-4da2-82ca-1e2beeaa4423 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/0e2c90ca-0ba4-4108-8455-28b382aa9b68" status: 200 len: 194 microversion: 2.1 time: 0.045384 Sep 22 17:17:23.006396 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 581/1159] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Sep 22 17:17:22 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/0e2c90ca-0ba4-4108-8455-28b382aa9b68 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:17:23.024011 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:23.037781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:23.040744 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:23.043007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8bee2fa3-a576-45e9-8a9b-38e9918cd834 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.198933 Sep 22 17:17:23.044153 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 579/1160] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:22 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:24.090940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:24.091750 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:24.102019 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:24.102920 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:24.103795 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:24.105135 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:24.106017 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:24.107132 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:24.321614 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:24.330660 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:24.332121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:24.333369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8bdcfe9e-2fc4-4213-b6fb-0ae312822472 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.246826 Sep 22 17:17:24.333960 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 582/1161] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:24 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 17:17:24.429374 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-dcd98274-98f9-44d9-a8ce-7a2d6bb56d41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88fc4020-e1c0-40b0-b5f4-9daead935851"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:17:24.432029 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-dcd98274-98f9-44d9-a8ce-7a2d6bb56d41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:24.439918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcd98274-98f9-44d9-a8ce-7a2d6bb56d41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:24.440404 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcd98274-98f9-44d9-a8ce-7a2d6bb56d41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:24.440836 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcd98274-98f9-44d9-a8ce-7a2d6bb56d41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:24.441544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcd98274-98f9-44d9-a8ce-7a2d6bb56d41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:24.441990 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcd98274-98f9-44d9-a8ce-7a2d6bb56d41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:24.442412 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-dcd98274-98f9-44d9-a8ce-7a2d6bb56d41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:24.762419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:17:24.774366 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-dcd98274-98f9-44d9-a8ce-7a2d6bb56d41 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "POST /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349177 Sep 22 17:17:24.775017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 580/1162] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:17:24 2022] POST /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:17:25.372489 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:25.373374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:25.380892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:25.381372 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:25.381799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:25.382495 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:25.382959 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:25.383487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:25.541380 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:25.551069 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:25.552568 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:25.553801 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4434907f-aaca-46e6-9f53-722efb5a0f25 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.188279 Sep 22 17:17:25.554386 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 583/1163] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:25 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:25.572716 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-511faf7a-e895-4ab4-97fd-249a84e067fc req-6215e306-a17e-4c7b-ae8c-4ed6afdc3c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3946f917-8585-453c-9eff-81ab4ba3b860", "name": "network-vif-plugged", "status": "completed", "tag": "53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:17:25.592539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-511faf7a-e895-4ab4-97fd-249a84e067fc req-6215e306-a17e-4c7b-ae8c-4ed6afdc3c02 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:25.593224 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-511faf7a-e895-4ab4-97fd-249a84e067fc req-6215e306-a17e-4c7b-ae8c-4ed6afdc3c02 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:25.593677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-511faf7a-e895-4ab4-97fd-249a84e067fc req-6215e306-a17e-4c7b-ae8c-4ed6afdc3c02 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:25.609101 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-511faf7a-e895-4ab4-97fd-249a84e067fc req-6215e306-a17e-4c7b-ae8c-4ed6afdc3c02 service nova] Creating event network-vif-plugged:53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7 for instance 3946f917-8585-453c-9eff-81ab4ba3b860 on hv-cinder-83538 Sep 22 17:17:25.614303 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-511faf7a-e895-4ab4-97fd-249a84e067fc req-6215e306-a17e-4c7b-ae8c-4ed6afdc3c02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050045 Sep 22 17:17:25.615175 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 581/1164] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:17:26.580616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:26.581374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:26.588166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:26.588656 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:26.589094 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:26.589807 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:26.590257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:26.590682 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:26.729374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:26.737823 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:26.739297 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:26.740465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b306efdd-4dcb-479d-9e0d-3a22e077a2b6 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.164478 Sep 22 17:17:26.741032 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 584/1165] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:26 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:27.772695 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:27.774181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:27.777844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=32 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:17:27.786269 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:27.786778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:27.787234 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:27.787963 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:27.788688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:27.789174 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:27.955710 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:27.966354 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:27.968851 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:27.970213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-86e2c9b5-198c-466c-9622-ac7b6889abce tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1730 microversion: 2.20 time: 0.207341 Sep 22 17:17:27.970820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 582/1166] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:27 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:28.997761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:28.998384 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:29.005707 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:29.006188 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:29.006617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:29.007341 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:29.007783 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:29.008203 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:29.156300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:29.165062 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:29.166508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:29.167738 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f76fbcbd-cede-4777-9d5e-75b701b912c0 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1717 microversion: 2.20 time: 0.174824 Sep 22 17:17:29.168308 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 585/1167] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:17:28 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:17:32.408677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-87f722c3-ac2c-4cf3-b549-4c2b599bf1d5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:32.410873 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-87f722c3-ac2c-4cf3-b549-4c2b599bf1d5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:32.417770 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87f722c3-ac2c-4cf3-b549-4c2b599bf1d5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:32.418251 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87f722c3-ac2c-4cf3-b549-4c2b599bf1d5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:32.418686 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87f722c3-ac2c-4cf3-b549-4c2b599bf1d5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:32.419424 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87f722c3-ac2c-4cf3-b549-4c2b599bf1d5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:32.419886 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87f722c3-ac2c-4cf3-b549-4c2b599bf1d5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:32.420314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-87f722c3-ac2c-4cf3-b549-4c2b599bf1d5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:32.455933 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-87f722c3-ac2c-4cf3-b549-4c2b599bf1d5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051778 Sep 22 17:17:32.456523 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 583/1168] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:17:32 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:17:32.595016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-235a3715-fe6c-4df8-b01d-b4805aed2db5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:32.595615 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-235a3715-fe6c-4df8-b01d-b4805aed2db5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:32.602168 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-235a3715-fe6c-4df8-b01d-b4805aed2db5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:32.602649 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-235a3715-fe6c-4df8-b01d-b4805aed2db5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:32.603112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-235a3715-fe6c-4df8-b01d-b4805aed2db5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:32.603812 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-235a3715-fe6c-4df8-b01d-b4805aed2db5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:32.604260 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-235a3715-fe6c-4df8-b01d-b4805aed2db5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:32.604685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-235a3715-fe6c-4df8-b01d-b4805aed2db5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:32.636599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-235a3715-fe6c-4df8-b01d-b4805aed2db5 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/0e2c90ca-0ba4-4108-8455-28b382aa9b68" status: 200 len: 194 microversion: 2.1 time: 0.046117 Sep 22 17:17:32.637375 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 586/1169] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Sep 22 17:17:32 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/0e2c90ca-0ba4-4108-8455-28b382aa9b68 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:17:32.648767 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:32.649265 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:32.656052 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:32.656534 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:32.656967 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:32.657669 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:32.658139 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:32.658545 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:32.741068 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lazy-loading 'services' on Instance uuid 30c17e4e-de77-41fc-b8a7-b73a85afe377 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:17:32.820028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e11b76f5-7f29-4437-8a51-c2bf3a0ae465 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/0e2c90ca-0ba4-4108-8455-28b382aa9b68" status: 202 len: 0 microversion: 2.1 time: 0.175160 Sep 22 17:17:32.820619 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 584/1170] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:17:32 2022] DELETE /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/0e2c90ca-0ba4-4108-8455-28b382aa9b68 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:17:35.022178 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-67b342c2-82c4-401e-b41c-cb0d31bf16a9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:35.022697 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-67b342c2-82c4-401e-b41c-cb0d31bf16a9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:35.029169 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-67b342c2-82c4-401e-b41c-cb0d31bf16a9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:35.029644 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-67b342c2-82c4-401e-b41c-cb0d31bf16a9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:35.030074 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-67b342c2-82c4-401e-b41c-cb0d31bf16a9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:35.030756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-67b342c2-82c4-401e-b41c-cb0d31bf16a9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:35.031230 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-67b342c2-82c4-401e-b41c-cb0d31bf16a9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:35.031649 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-67b342c2-82c4-401e-b41c-cb0d31bf16a9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:35.062601 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-67b342c2-82c4-401e-b41c-cb0d31bf16a9 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/88fc4020-e1c0-40b0-b5f4-9daead935851" status: 200 len: 194 microversion: 2.1 time: 0.044379 Sep 22 17:17:35.063257 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 587/1171] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Sep 22 17:17:35 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/88fc4020-e1c0-40b0-b5f4-9daead935851 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:17:35.075054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:35.075653 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:35.081811 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:35.082287 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:35.082717 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:35.083417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:35.083861 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:35.084273 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:35.169177 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lazy-loading 'services' on Instance uuid 30c17e4e-de77-41fc-b8a7-b73a85afe377 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:17:35.244573 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-86c18cc8-c283-4ba5-b223-8bd5e6edce61 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/88fc4020-e1c0-40b0-b5f4-9daead935851" status: 202 len: 0 microversion: 2.1 time: 0.174307 Sep 22 17:17:35.245170 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 585/1172] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:17:35 2022] DELETE /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments/88fc4020-e1c0-40b0-b5f4-9daead935851 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:17:36.421077 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-4eb63ba5-c2ed-4b2e-8fe5-3819d495e7e3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:36.423279 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-4eb63ba5-c2ed-4b2e-8fe5-3819d495e7e3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:36.429870 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eb63ba5-c2ed-4b2e-8fe5-3819d495e7e3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:36.430354 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eb63ba5-c2ed-4b2e-8fe5-3819d495e7e3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:36.430782 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eb63ba5-c2ed-4b2e-8fe5-3819d495e7e3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:36.431494 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eb63ba5-c2ed-4b2e-8fe5-3819d495e7e3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:36.431939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eb63ba5-c2ed-4b2e-8fe5-3819d495e7e3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:36.432357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-4eb63ba5-c2ed-4b2e-8fe5-3819d495e7e3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:36.461186 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-4eb63ba5-c2ed-4b2e-8fe5-3819d495e7e3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044460 Sep 22 17:17:36.461731 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 588/1173] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:17:36 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 17:17:36.584207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-55b381ea-9170-4e9d-9260-a1454d0f237c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:36.586550 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-55b381ea-9170-4e9d-9260-a1454d0f237c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:36.593711 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55b381ea-9170-4e9d-9260-a1454d0f237c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:36.594225 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55b381ea-9170-4e9d-9260-a1454d0f237c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:36.594670 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55b381ea-9170-4e9d-9260-a1454d0f237c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:36.595503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55b381ea-9170-4e9d-9260-a1454d0f237c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:36.595952 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55b381ea-9170-4e9d-9260-a1454d0f237c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:36.596375 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-55b381ea-9170-4e9d-9260-a1454d0f237c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:36.626349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-55b381ea-9170-4e9d-9260-a1454d0f237c tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047005 Sep 22 17:17:36.626855 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 586/1174] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:17:36 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 17:17:36.695843 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:36.696335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:36.702376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:36.702857 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:36.703319 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:36.704009 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:36.704458 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:36.704874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:36.730890 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:17:36.746446 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=100 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:17:36.821763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d9ee4f33-0cff-4f7f-bb3b-c063888166c3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 204 len: 0 microversion: 2.1 time: 0.129272 Sep 22 17:17:36.822673 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 589/1175] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:17:36 2022] DELETE /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:17:36.830927 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:36.831626 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:36.840541 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:36.841021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:36.841447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:36.842672 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:36.843369 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:36.843791 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:36.977282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:36.985115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-81105b5c-1e80-4e94-91e0-77393c8b1002 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1673 microversion: 2.1 time: 0.158115 Sep 22 17:17:36.985686 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 587/1176] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:17:36 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:17:38.008775 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:38.009470 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:38.016097 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:38.016509 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:38.016945 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:38.017648 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:38.018105 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:38.018523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:38.152315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:38.160741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bf7faca4-e26c-4979-b4ed-f3bc1c733387 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1673 microversion: 2.1 time: 0.156197 Sep 22 17:17:38.161539 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 590/1177] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:17:38 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:17:39.185247 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:39.186428 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:39.192941 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:39.193419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:39.193953 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:39.194537 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:39.195001 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:39.195415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:39.437463 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:39.457034 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2dd948f0-d8b2-494d-be5e-755cfd72233b tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1673 microversion: 2.1 time: 0.275692 Sep 22 17:17:39.457807 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 588/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:17:39 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1673 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:17:40.112183 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-2650a0c7-ac46-4856-8394-1191bbfb6cc6 req-10326391-0999-416c-a00d-8e574ecce515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30c17e4e-de77-41fc-b8a7-b73a85afe377", "name": "network-vif-deleted", "tag": "f3b5bffd-1d78-4175-8bd6-0243dd912596"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:17:40.125115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-2650a0c7-ac46-4856-8394-1191bbfb6cc6 req-10326391-0999-416c-a00d-8e574ecce515 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:40.125559 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-2650a0c7-ac46-4856-8394-1191bbfb6cc6 req-10326391-0999-416c-a00d-8e574ecce515 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:40.125987 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-2650a0c7-ac46-4856-8394-1191bbfb6cc6 req-10326391-0999-416c-a00d-8e574ecce515 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:40.138867 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-2650a0c7-ac46-4856-8394-1191bbfb6cc6 req-10326391-0999-416c-a00d-8e574ecce515 service nova] Creating event network-vif-deleted:f3b5bffd-1d78-4175-8bd6-0243dd912596 for instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 on hv-cinder-83538 Sep 22 17:17:40.144518 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-2650a0c7-ac46-4856-8394-1191bbfb6cc6 req-10326391-0999-416c-a00d-8e574ecce515 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036101 Sep 22 17:17:40.145371 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 591/1179] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:17:40.480949 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:40.481556 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:40.488112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:40.488593 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:40.489018 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:40.489704 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:40.490150 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:40.490591 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:40.523339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:40.523762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:40.524192 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:40.524632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lazy-loading 'fault' on Instance uuid 30c17e4e-de77-41fc-b8a7-b73a85afe377 {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:17:40.570998 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f8fd9a74e48afa2f8b74b090a8dd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2abeb0b54520461cb414ea9c0599380f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:17:40.579651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9d5768ee-2783-4805-ab2a-2fddce2520e4 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 200 len: 1327 microversion: 2.1 time: 0.102591 Sep 22 17:17:40.580248 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 589/1180] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:17:40 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:17:41.603465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:41.604191 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:41.611176 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:41.611667 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:41.612103 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:41.612790 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:41.613246 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:41.613674 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:41.626836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] HTTP exception thrown: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Request method failure captured: Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 HTTP/1.1 Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZJRi77leB-i9hVM_qo2B-vDF03ieah0VwDwTWBCauVRPRhdBbKNVWbdWetW_S4jF_Ylmya7Ngfyx8_ic8e2qM6NEIK7UNlN0QDatW6G5kOm1zCBw-F9WNzRvNO5GV6wsgVxAtA4c-c-i3-1FrzzbOrudP6xWuHwBfIw4bYpy1sWNk Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:17:41.628459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 624f8fd9a74e48afa2f8b74b090a8dd6 Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:41.630104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '30c17e4e-de77-41fc-b8a7-b73a85afe377'} Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:17:41.631098 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:41.632665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:41.634067 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Returning 404 to user: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:17:41.634067 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-985c4d1e-c6d9-4937-847a-b82915d8d445 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 404 len: 111 microversion: 2.1 time: 0.030659 Sep 22 17:17:41.634067 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 592/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:17:41 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:17:41.638535 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b388feea-9d93-4bad-9682-c0543b0cbb1d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '.version_select at 0x7f51d9704b80>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:41.658319 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b388feea-9d93-4bad-9682-c0543b0cbb1d tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522213555" status: 202 len: 0 microversion: 2.1 time: 0.023416 Sep 22 17:17:41.658909 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 590/1182] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 22 17:17:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522213555 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:17:44.588029 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:44.588578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:44.591049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:17:44.597040 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:44.597526 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:44.597959 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:44.598654 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:44.599149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:44.599574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:44.613573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] HTTP exception thrown: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Request method failure captured: Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: DELETE /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 HTTP/1.1 Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZJRi77leB-i9hVM_qo2B-vDF03ieah0VwDwTWBCauVRPRhdBbKNVWbdWetW_S4jF_Ylmya7Ngfyx8_ic8e2qM6NEIK7UNlN0QDatW6G5kOm1zCBw-F9WNzRvNO5GV6wsgVxAtA4c-c-i3-1FrzzbOrudP6xWuHwBfIw4bYpy1sWNk Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:17:44.615160 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 624f8fd9a74e48afa2f8b74b090a8dd6 Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.616770 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '30c17e4e-de77-41fc-b8a7-b73a85afe377'} Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:17:44.617696 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.619197 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.620750 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Returning 404 to user: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:17:44.620750 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-802d1ece-766c-42d8-b047-32edfa8298b3 tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 404 len: 111 microversion: 2.1 time: 0.032366 Sep 22 17:17:44.620750 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 593/1183] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:17:44 2022] DELETE /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:17:44.622506 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 17:17:44.623044 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Thu Sep 22 17:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 (ip 10.222.0.16) !!! Sep 22 17:17:44.627822 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:44.630707 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 30c17e4e-de77-41fc-b8a7-b73a85afe377] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:44.637786 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:44.638262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:44.638690 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:44.639900 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:44.640343 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:44.640766 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:44.655157 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] HTTP exception thrown: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Request method failure captured: Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 HTTP/1.1 Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZJRi77leB-i9hVM_qo2B-vDF03ieah0VwDwTWBCauVRPRhdBbKNVWbdWetW_S4jF_Ylmya7Ngfyx8_ic8e2qM6NEIK7UNlN0QDatW6G5kOm1zCBw-F9WNzRvNO5GV6wsgVxAtA4c-c-i3-1FrzzbOrudP6xWuHwBfIw4bYpy1sWNk Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:17:44.656815 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: 624f8fd9a74e48afa2f8b74b090a8dd6 Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.658402 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '30c17e4e-de77-41fc-b8a7-b73a85afe377'} Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:17:44.659266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. Sep 22 17:17:44.660526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:44.661612 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Returning 404 to user: Instance 30c17e4e-de77-41fc-b8a7-b73a85afe377 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:17:44.661612 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-214e9ef2-9714-4d24-a775-090f9d2fc59e tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377" status: 404 len: 111 microversion: 2.1 time: 0.036977 Sep 22 17:17:44.661612 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 591/1184] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:17:44 2022] GET /compute/v2.1/servers/30c17e4e-de77-41fc-b8a7-b73a85afe377 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:17:45.805671 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:45.806229 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:45.812963 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:45.813437 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:45.813871 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:45.814574 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:45.815071 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:45.815483 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:45.829358 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] HTTP exception thrown: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Request method failure captured: Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: DELETE /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 HTTP/1.1 Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZJRi77leB-i9hVM_qo2B-vDF03ieah0VwDwTWBCauVRPRhdBbKNVWbdWetW_S4jF_Ylmya7Ngfyx8_ic8e2qM6NEIK7UNlN0QDatW6G5kOm1zCBw-F9WNzRvNO5GV6wsgVxAtA4c-c-i3-1FrzzbOrudP6xWuHwBfIw4bYpy1sWNk Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:17:45.830969 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 624f8fd9a74e48afa2f8b74b090a8dd6 Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.832586 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '979379b2-1673-4425-be3f-98d99729db47'} Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:17:45.833442 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.834896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.836546 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Returning 404 to user: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:17:45.836546 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-46981ec7-3f4c-432b-b0bb-225e10bc3a0f tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "DELETE /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 404 len: 111 microversion: 2.1 time: 0.030589 Sep 22 17:17:45.836546 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 594/1185] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:17:45 2022] DELETE /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:17:45.841021 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:45.841639 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] [instance: 979379b2-1673-4425-be3f-98d99729db47] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:45.848955 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:45.849447 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:45.849886 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:45.850588 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:45.851075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:45.851503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:45.866575 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] HTTP exception thrown: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Request method failure captured: Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 HTTP/1.1 Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZJRi77leB-i9hVM_qo2B-vDF03ieah0VwDwTWBCauVRPRhdBbKNVWbdWetW_S4jF_Ylmya7Ngfyx8_ic8e2qM6NEIK7UNlN0QDatW6G5kOm1zCBw-F9WNzRvNO5GV6wsgVxAtA4c-c-i3-1FrzzbOrudP6xWuHwBfIw4bYpy1sWNk Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:17:45.868203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2abeb0b54520461cb414ea9c0599380f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 2abeb0b54520461cb414ea9c0599380f Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeTestJSON-94590692 Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: 624f8fd9a74e48afa2f8b74b090a8dd6 Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeTestJSON-94590692-project Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.869891 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '979379b2-1673-4425-be3f-98d99729db47'} Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:17:45.870898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. Sep 22 17:17:45.872421 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:17:45.873906 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] Returning 404 to user: Instance 979379b2-1673-4425-be3f-98d99729db47 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:17:45.873906 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-936fb3b2-c4ef-4219-8b2a-5f80c9b954aa tempest-AttachVolumeTestJSON-94590692 tempest-AttachVolumeTestJSON-94590692-project] 10.222.0.16 "GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47" status: 404 len: 111 microversion: 2.1 time: 0.032490 Sep 22 17:17:45.873906 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 592/1186] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:17:45 2022] GET /compute/v2.1/servers/979379b2-1673-4425-be3f-98d99729db47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:17:52.305045 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7ebadbfd-6683-4c96-a1c9-ada45a1ee5f1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:17:52.305651 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7ebadbfd-6683-4c96-a1c9-ada45a1ee5f1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:52.312859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ebadbfd-6683-4c96-a1c9-ada45a1ee5f1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:52.313350 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ebadbfd-6683-4c96-a1c9-ada45a1ee5f1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:52.313789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ebadbfd-6683-4c96-a1c9-ada45a1ee5f1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:52.314487 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ebadbfd-6683-4c96-a1c9-ada45a1ee5f1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:52.315077 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ebadbfd-6683-4c96-a1c9-ada45a1ee5f1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:52.315512 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7ebadbfd-6683-4c96-a1c9-ada45a1ee5f1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:52.340833 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7ebadbfd-6683-4c96-a1c9-ada45a1ee5f1 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/ips" status: 200 len: 149 microversion: 2.1 time: 0.039638 Sep 22 17:17:52.341410 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 595/1187] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 22 17:17:52 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:17:56.860890 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a31c665d-bd15-4642-a3c0-706cee4ab38b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbb32fc3-83f0-4020-bd88-ff6d27da5693"}} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:17:56.863267 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a31c665d-bd15-4642-a3c0-706cee4ab38b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:17:56.865857 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:17:56.866592 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:17:56.873353 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a31c665d-bd15-4642-a3c0-706cee4ab38b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:56.873838 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a31c665d-bd15-4642-a3c0-706cee4ab38b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:56.874276 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a31c665d-bd15-4642-a3c0-706cee4ab38b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:56.874996 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a31c665d-bd15-4642-a3c0-706cee4ab38b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:17:56.875578 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a31c665d-bd15-4642-a3c0-706cee4ab38b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:17:56.876005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a31c665d-bd15-4642-a3c0-706cee4ab38b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:17:57.238497 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a31c665d-bd15-4642-a3c0-706cee4ab38b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "POST /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381714 Sep 22 17:17:57.239744 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 593/1188] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 22 17:17:56 2022] POST /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:18:02.767317 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2127164004", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-880029579", "security_groups": [{"name": "tempest-secgroup-smoke-805804894"}], "block_device_mapping_v2": [{"uuid": "cd7e2157-e5fd-4a4d-a3fa-c0dbebbbbf16", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1876d1ce-e761-46f2-ab46-b61110e15c2c"}]}} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:18:02.777931 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=5 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:18:02.778617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:18:02.888817 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.network.neutron [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] validate_networks() for [('1876d1ce-e761-46f2-ab46-b61110e15c2c', None, None, None, None, None)] {{(pid=120804) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 17:18:03.383023 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Flavor limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 17:18:03.383465 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Image limits 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 17:18:03.384005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Flavor pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 17:18:03.384502 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Image pref 0:0:0 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 17:18:03.384919 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.virt.hardware [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120804) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 17:18:03.395204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:03.395692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:03.396126 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:03.396840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:03.397286 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:03.397705 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:03.414564 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Getting quotas for project 5fca6eabbca24bc09aee7e259ca82562. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 17:18:03.418686 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.quota [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Getting quotas for user c2060b33d0a24e01a96ab3fb02b4b045 and project 5fca6eabbca24bc09aee7e259ca82562. Resources: {'cores', 'ram', 'instances'} {{(pid=120804) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 17:18:03.477425 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Going to run 1 instances... {{(pid=120804) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 17:18:03.479600 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd7e2157-e5fd-4a4d-a3fa-c0dbebbbbf16',volume_size=None,volume_type=None)] {{(pid=120804) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 17:18:03.610165 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-83c7e7b6-d96c-4e2c-9434-0cedcdf8d40c tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.846450 Sep 22 17:18:03.611407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 596/1189] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 22 17:18:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 17:18:03.632159 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7af2dad4-7186-4f8d-9076-8d265c395ab3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:03.633360 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7af2dad4-7186-4f8d-9076-8d265c395ab3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:03.692585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7af2dad4-7186-4f8d-9076-8d265c395ab3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:03.701048 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7af2dad4-7186-4f8d-9076-8d265c395ab3 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1094 microversion: 2.1 time: 0.077274 Sep 22 17:18:03.710982 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 594/1190] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:03 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:04.725274 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:04.726064 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:04.733790 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:04.734282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:04.734726 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:04.735538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:04.736079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:04.736558 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:04.834378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:04.844405 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-7d30446a-41dc-46a4-813e-2875d8d25d95 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1192 microversion: 2.1 time: 0.123124 Sep 22 17:18:04.845136 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 597/1191] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:04 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1192 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:05.868047 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:05.868665 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:05.879714 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:05.880259 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:05.880636 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:05.881349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:05.887427 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:05.887427 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:06.160507 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:06.172883 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-196bcf40-201e-4731-aaba-d7b56f4bf015 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1277 microversion: 2.1 time: 0.308551 Sep 22 17:18:06.173530 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 595/1192] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:05 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:06.556787 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-d01877fc-b970-424a-93ba-28259d85a266 req-d35253b2-efe1-4a7d-93d6-79cc793e0ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67aca1b1-ea8d-44ef-8332-d7d1bed31c9f", "tag": "b87b30f0-d4bd-44de-ab2b-cbd612d168ea"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:18:06.567992 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d01877fc-b970-424a-93ba-28259d85a266 req-d35253b2-efe1-4a7d-93d6-79cc793e0ac9 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:06.568600 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d01877fc-b970-424a-93ba-28259d85a266 req-d35253b2-efe1-4a7d-93d6-79cc793e0ac9 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:06.569035 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-d01877fc-b970-424a-93ba-28259d85a266 req-d35253b2-efe1-4a7d-93d6-79cc793e0ac9 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:06.580556 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-d01877fc-b970-424a-93ba-28259d85a266 req-d35253b2-efe1-4a7d-93d6-79cc793e0ac9 service nova] Creating event network-changed:b87b30f0-d4bd-44de-ab2b-cbd612d168ea for instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f on hv-cinder-83538 Sep 22 17:18:06.585493 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-d01877fc-b970-424a-93ba-28259d85a266 req-d35253b2-efe1-4a7d-93d6-79cc793e0ac9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032698 Sep 22 17:18:06.586006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 598/1193] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:18:07.197828 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:07.198560 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:07.205712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:07.206196 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:07.206677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:07.207375 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:07.207831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:07.208258 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:07.451183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:07.460525 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5303b309-84a0-41fd-8d52-5d03e6cffa51 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1277 microversion: 2.1 time: 0.266596 Sep 22 17:18:07.461778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 596/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:07 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:08.484817 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:08.485523 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:08.491780 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:08.492293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:08.492732 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:08.493423 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:08.493877 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:08.494301 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:08.631376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:08.639369 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-790be873-8044-4281-971f-26aafeec7966 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1277 microversion: 2.1 time: 0.159291 Sep 22 17:18:08.640826 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 599/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:08 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:09.666238 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:09.666897 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:09.675460 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:09.675966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:09.676392 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:09.677099 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:09.677732 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:09.678227 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:09.823823 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:09.831884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8f922fce-3eeb-4535-90d7-75bb760bf923 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1277 microversion: 2.1 time: 0.170850 Sep 22 17:18:09.832704 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 597/1196] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:09 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:10.302884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:10.303515 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:10.309862 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:10.310335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:10.310763 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:10.311964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:10.312411 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:10.312827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:10.395226 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'services' on Instance uuid 317daea2-77e2-4c68-b9e3-849b3164d8f2 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:18:10.467315 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-3774af35-6f08-454a-aecf-02c0ce23366c tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments/dbb32fc3-83f0-4020-bd88-ff6d27da5693" status: 202 len: 0 microversion: 2.1 time: 0.168402 Sep 22 17:18:10.467929 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 600/1197] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 22 17:18:10 2022] DELETE /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments/dbb32fc3-83f0-4020-bd88-ff6d27da5693 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 17:18:10.476441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0e596c4a-4f30-4e7f-9cfe-fc50c5dc25c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:10.478765 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0e596c4a-4f30-4e7f-9cfe-fc50c5dc25c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:10.484820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e596c4a-4f30-4e7f-9cfe-fc50c5dc25c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:10.485309 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e596c4a-4f30-4e7f-9cfe-fc50c5dc25c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:10.485746 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e596c4a-4f30-4e7f-9cfe-fc50c5dc25c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:10.486441 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e596c4a-4f30-4e7f-9cfe-fc50c5dc25c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:10.486898 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e596c4a-4f30-4e7f-9cfe-fc50c5dc25c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:10.487349 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0e596c4a-4f30-4e7f-9cfe-fc50c5dc25c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:10.518554 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0e596c4a-4f30-4e7f-9cfe-fc50c5dc25c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046075 Sep 22 17:18:10.519165 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 598/1198] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:18:10 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:18:10.855937 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:10.856632 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:10.863461 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:10.863948 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:10.864381 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:10.865068 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:10.865518 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:10.865940 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:11.007513 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:11.016555 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-ce4e4bb4-d147-44ef-bc62-ee9ac602d81f tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.164298 Sep 22 17:18:11.017327 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 601/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:10 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:11.531504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5ddb9fd8-a611-4521-a583-cd098cc1a492 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:11.533757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5ddb9fd8-a611-4521-a583-cd098cc1a492 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:11.540469 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ddb9fd8-a611-4521-a583-cd098cc1a492 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:11.540953 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ddb9fd8-a611-4521-a583-cd098cc1a492 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:11.541392 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ddb9fd8-a611-4521-a583-cd098cc1a492 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:11.542083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ddb9fd8-a611-4521-a583-cd098cc1a492 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:11.542803 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ddb9fd8-a611-4521-a583-cd098cc1a492 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:11.543578 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5ddb9fd8-a611-4521-a583-cd098cc1a492 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:11.576166 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5ddb9fd8-a611-4521-a583-cd098cc1a492 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049768 Sep 22 17:18:11.576656 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 599/1200] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:18:11 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:18:12.041685 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:12.042528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:12.049979 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:12.050460 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:12.050885 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:12.051718 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:12.052230 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:12.052684 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:12.189452 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:12.197194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-226fbf2f-2886-402c-be41-ce3671e08750 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.159391 Sep 22 17:18:12.197768 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 602/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:12 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:12.589689 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f53a4f82-52f2-4a44-a229-fc70101c3171 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:12.592064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f53a4f82-52f2-4a44-a229-fc70101c3171 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:12.599529 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53a4f82-52f2-4a44-a229-fc70101c3171 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:12.600113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53a4f82-52f2-4a44-a229-fc70101c3171 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:12.600657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53a4f82-52f2-4a44-a229-fc70101c3171 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:12.601484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53a4f82-52f2-4a44-a229-fc70101c3171 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:12.601940 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53a4f82-52f2-4a44-a229-fc70101c3171 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:12.602362 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f53a4f82-52f2-4a44-a229-fc70101c3171 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:12.631463 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f53a4f82-52f2-4a44-a229-fc70101c3171 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046091 Sep 22 17:18:12.632022 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 600/1202] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 22 17:18:12 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 17:18:12.694624 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:12.695149 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:12.701425 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:12.701848 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:12.702282 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:12.703100 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:12.703572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:12.704024 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:12.730287 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Going to try to terminate instance {{(pid=120804) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:18:12.813735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-9ae9d522-490c-4ce1-b48c-d0f937f06f47 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 204 len: 0 microversion: 2.1 time: 0.122491 Sep 22 17:18:12.815057 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 603/1203] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:18:12 2022] DELETE /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:18:12.823829 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:12.824435 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:12.831089 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:12.831928 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:12.832358 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:12.833080 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:12.833521 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:12.833937 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:12.981634 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:12.990135 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-96ecec39-33f5-415c-ac85-e93aec206078 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1681 microversion: 2.1 time: 0.170557 Sep 22 17:18:12.990700 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 601/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:12 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:13.221085 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:13.221820 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:13.227913 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:13.228331 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:13.228769 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:13.229472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:13.229926 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:13.230353 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:13.377709 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:13.385761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-02ec490c-a443-44dc-8af8-56f07a221d8b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.169637 Sep 22 17:18:13.386300 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 604/1205] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:13 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:14.018193 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:14.019525 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:14.023307 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell0:SELECT=2 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:18:14.027430 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:14.027947 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:14.028386 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:14.029084 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:14.029539 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:14.029962 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:14.171573 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:14.180505 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-698792cd-8f5d-4d8e-99fa-697cda344534 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1681 microversion: 2.1 time: 0.166703 Sep 22 17:18:14.181085 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 602/1206] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:14 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:14.410324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:14.410931 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:14.413639 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=2 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:18:14.414406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell0:SELECT=6 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:18:14.421440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:14.421869 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:14.422302 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:14.423024 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:14.423459 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:14.423873 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:14.561194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:14.569227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b9ba8d26-e556-4579-a414-39c10670d862 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.162660 Sep 22 17:18:14.569765 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 605/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:14 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:15.204940 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:15.205785 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:15.214825 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:15.215520 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:15.216145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:15.217005 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:15.217643 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:15.218231 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:15.476173 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:15.487778 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-eefcd3b8-ab54-402a-b013-963bdd434586 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1681 microversion: 2.1 time: 0.286865 Sep 22 17:18:15.489182 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 603/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:15 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:15.593001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:15.593705 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:15.602155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:15.602981 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:15.603669 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:15.604760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:15.605443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:15.606087 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:15.834431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:15.845549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f3e18b3d-bb96-49da-804d-1b114d6ecc05 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.256818 Sep 22 17:18:15.862395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 606/1209] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:15 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:16.008864 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-b0552a0f-7ca0-4b9c-8a36-01ad637e6c15 req-926e4e6c-086b-4d2c-89b7-58dcbd536e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317daea2-77e2-4c68-b9e3-849b3164d8f2", "name": "network-vif-deleted", "tag": "8666e805-fb54-4f7d-baa6-8a55d3805878"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:18:16.020278 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b0552a0f-7ca0-4b9c-8a36-01ad637e6c15 req-926e4e6c-086b-4d2c-89b7-58dcbd536e24 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:16.021115 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b0552a0f-7ca0-4b9c-8a36-01ad637e6c15 req-926e4e6c-086b-4d2c-89b7-58dcbd536e24 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:16.021688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-b0552a0f-7ca0-4b9c-8a36-01ad637e6c15 req-926e4e6c-086b-4d2c-89b7-58dcbd536e24 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:16.034342 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-b0552a0f-7ca0-4b9c-8a36-01ad637e6c15 req-926e4e6c-086b-4d2c-89b7-58dcbd536e24 service nova] Creating event network-vif-deleted:8666e805-fb54-4f7d-baa6-8a55d3805878 for instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 on hv-cinder-83538 Sep 22 17:18:16.055639 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-b0552a0f-7ca0-4b9c-8a36-01ad637e6c15 req-926e4e6c-086b-4d2c-89b7-58dcbd536e24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041971 Sep 22 17:18:16.055639 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 604/1210] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:18:16.517436 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:16.518055 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:16.524219 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:16.524715 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:16.525153 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:16.525859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:16.526312 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:16.526735 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:16.592186 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:16.600731 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-22fecbc5-a78b-493c-a084-e715a5ac99ac tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1326 microversion: 2.1 time: 0.087108 Sep 22 17:18:16.601324 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 607/1211] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:16 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:16.870881 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:16.871523 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:16.878085 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:16.878709 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:16.879289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:16.880098 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:16.880686 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:16.881181 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:17.017824 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:17.026145 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b239886d-8871-4214-84fb-7a7bdb27c66d tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.160492 Sep 22 17:18:17.026796 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 605/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:16 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:17.624725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:17.625388 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:17.632019 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:17.632421 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:17.632875 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:17.633625 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:17.634079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:17.634529 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:17.667831 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:17.668223 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:17.668665 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:17.669113 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'fault' on Instance uuid 317daea2-77e2-4c68-b9e3-849b3164d8f2 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:18:17.713710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:17.721732 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f3fe3f32-3836-4063-ac77-c1ce7a3ce609 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1331 microversion: 2.1 time: 0.101575 Sep 22 17:18:17.722302 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 608/1213] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:17 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:18.050463 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:18.051147 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:18.057615 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:18.058096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:18.058526 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:18.059240 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:18.059693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:18.060114 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:18.189494 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:18.197148 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a82c31c6-989e-4b7c-a015-75ee0404f017 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.151488 Sep 22 17:18:18.197712 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 606/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:18 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:18.745364 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:18.745996 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:18.752489 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:18.752962 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:18.753455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:18.754079 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:18.754528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:18.754961 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:18.786181 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:18.786644 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:18.787111 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:18.787616 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'fault' on Instance uuid 317daea2-77e2-4c68-b9e3-849b3164d8f2 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:18:18.827966 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:18.836895 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-34776ba6-1009-4a8b-bd85-12489a84c2fe tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1331 microversion: 2.1 time: 0.095415 Sep 22 17:18:18.837456 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 609/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:18 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:19.220417 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:19.221096 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:19.227503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:19.227987 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:19.228426 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:19.229112 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:19.229582 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:19.229990 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:19.365008 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:19.372658 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b198cff0-1b8a-439d-bc5e-c181b0c40ff5 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.156847 Sep 22 17:18:19.373230 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 607/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:19 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:19.860959 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:19.861565 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:19.867938 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:19.868412 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:19.868842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:19.869520 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:19.869965 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:19.870383 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:19.900604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:19.901068 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:19.901497 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:19.901932 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'fault' on Instance uuid 317daea2-77e2-4c68-b9e3-849b3164d8f2 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:18:19.904528 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:18:19.943999 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:19.951611 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f0bd40ca-8da4-40e5-b9d3-c8ae461efb92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1331 microversion: 2.1 time: 0.095057 Sep 22 17:18:19.952179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 610/1217] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:19 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:18:20.395664 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:20.396209 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:20.402816 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:20.403336 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:20.403777 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:20.404472 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:20.405490 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:20.405833 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:20.537445 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:20.545128 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-88c8e260-6653-4bb4-88da-83c763537ec8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.153425 Sep 22 17:18:20.545732 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 608/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:20 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:20.973859 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:20.974469 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:20.981014 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:20.981496 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:20.981930 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:20.982619 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:20.983104 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:20.983526 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:21.013954 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:21.015140 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:21.015505 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:21.015939 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lazy-loading 'fault' on Instance uuid 317daea2-77e2-4c68-b9e3-849b3164d8f2 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:18:21.066378 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feea3b3b7e4401ea7db242cb60fdfcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6e3ace80a4a43b2b187060d6eca8538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:21.074410 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-2fd1ce6e-4f44-4ae2-8394-cf6c2674f443 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 200 len: 1331 microversion: 2.1 time: 0.104505 Sep 22 17:18:21.074990 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 611/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:20 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:21.568553 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:21.569248 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:21.575632 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:21.576113 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:21.576550 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:21.577878 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:21.578329 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:21.578747 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:21.708751 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:21.712317 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:18:21.717354 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8843dfce-b191-4185-ae6e-63abffdf2bc8 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.152760 Sep 22 17:18:21.717918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 609/1220] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:21 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:22.097549 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:22.098165 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:22.104638 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:22.105124 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:22.105562 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:22.106252 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:22.106709 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:22.107180 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:22.120817 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 HTTP/1.1 Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:18:22.122440 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:22.124761 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '317daea2-77e2-4c68-b9e3-849b3164d8f2'} Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:18:22.125626 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:22.127047 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:22.128344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:18:22.128344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d821855a-e6fa-4dc6-945d-34e18e7c5e03 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 404 len: 111 microversion: 2.1 time: 0.030216 Sep 22 17:18:22.128344 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 612/1221] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:22 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:18:22.133354 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e029526e-0f4b-4596-b9a1-7d26a6e87c92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '.version_select at 0x7f51d93f8b80>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:22.152179 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e029526e-0f4b-4596-b9a1-7d26a6e87c92 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-971267443" status: 202 len: 0 microversion: 2.1 time: 0.022655 Sep 22 17:18:22.152740 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 610/1222] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 22 17:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-971267443 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 17:18:22.740597 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:22.741475 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:22.747406 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:22.748112 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:22.748589 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:22.749293 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:22.749741 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:22.750166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:22.904011 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:22.913478 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-69f58a7d-fb52-4dc4-b808-02b15cb7fda9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.177001 Sep 22 17:18:22.914072 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 613/1223] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:22 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:23.937485 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:23.938097 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:23.944162 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:23.944945 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:23.945407 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:23.946110 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:23.946561 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:23.947007 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:23.959835 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:23.960343 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:23.966266 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:23.966757 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:23.967238 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:23.968551 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:23.969056 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:23.969508 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:23.984395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: DELETE /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 HTTP/1.1 Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:18:23.985964 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:23.987617 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '317daea2-77e2-4c68-b9e3-849b3164d8f2'} Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:18:23.988540 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:23.990020 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:23.991827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:18:23.991827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a1fd1099-e79f-4130-8f6d-84491333e168 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 404 len: 111 microversion: 2.1 time: 0.031540 Sep 22 17:18:23.991827 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 614/1224] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:18:23 2022] DELETE /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 17:18:23.995674 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:23.996296 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 317daea2-77e2-4c68-b9e3-849b3164d8f2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:24.002262 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:24.002746 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:24.003216 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:24.003917 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:24.004371 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:24.004799 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:24.019006 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 HTTP/1.1 Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:18:24.020699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:24.022275 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '317daea2-77e2-4c68-b9e3-849b3164d8f2'} Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:18:24.023179 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. Sep 22 17:18:24.024599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:24.025896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance 317daea2-77e2-4c68-b9e3-849b3164d8f2 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:18:24.025896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-197a1cf3-0660-420b-9e33-d41a527773b4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2" status: 404 len: 111 microversion: 2.1 time: 0.030065 Sep 22 17:18:24.025896 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 615/1225] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:23 2022] GET /compute/v2.1/servers/317daea2-77e2-4c68-b9e3-849b3164d8f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:18:24.106855 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:24.115675 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a11d3a15-11d3-4d4e-9194-0356cfcf3386 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.182586 Sep 22 17:18:24.116252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 611/1226] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:23 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:24.299025 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-ad16f13e-e86d-49b2-b83d-dfce8047f449 req-9dd334f5-40d3-4158-8fd8-4f871aca4cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67aca1b1-ea8d-44ef-8332-d7d1bed31c9f", "name": "network-vif-plugged", "status": "completed", "tag": "b87b30f0-d4bd-44de-ab2b-cbd612d168ea"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:18:24.309065 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-ad16f13e-e86d-49b2-b83d-dfce8047f449 req-9dd334f5-40d3-4158-8fd8-4f871aca4cbf service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:24.309572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-ad16f13e-e86d-49b2-b83d-dfce8047f449 req-9dd334f5-40d3-4158-8fd8-4f871aca4cbf service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:24.310002 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-ad16f13e-e86d-49b2-b83d-dfce8047f449 req-9dd334f5-40d3-4158-8fd8-4f871aca4cbf service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:24.323479 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-ad16f13e-e86d-49b2-b83d-dfce8047f449 req-9dd334f5-40d3-4158-8fd8-4f871aca4cbf service nova] Creating event network-vif-plugged:b87b30f0-d4bd-44de-ab2b-cbd612d168ea for instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f on hv-cinder-83538 Sep 22 17:18:24.328861 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-ad16f13e-e86d-49b2-b83d-dfce8047f449 req-9dd334f5-40d3-4158-8fd8-4f871aca4cbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158675 Sep 22 17:18:24.329454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 616/1227] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:18:25.137757 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:25.138354 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:25.144774 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:25.145262 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:25.145693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:25.146393 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:25.146842 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:25.147292 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:25.284443 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:25.292157 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-7bcf7f3e-8aa8-455b-b74b-546a5b3fcb5b tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.158386 Sep 22 17:18:25.292723 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 612/1228] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:25 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:26.318905 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:26.319644 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:26.325754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:26.326232 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:26.326662 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:26.328147 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:26.328595 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:26.329046 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:26.470582 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:26.478277 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-23dc704f-51b5-4f14-8a69-3139ca2a39dd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.164257 Sep 22 17:18:26.478836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 617/1229] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:26 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:18:27.507518 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:27.508136 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:27.510487 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:18:27.516484 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:27.516973 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:27.517409 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:27.518109 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:27.518612 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:27.519019 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:27.656000 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:27.663661 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-9dea6e9e-69e5-435c-bdfd-69aa4cc3aae2 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.166128 Sep 22 17:18:27.664258 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 613/1230] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:27 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:28.685680 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:28.686326 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:28.692872 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:28.693354 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:28.693789 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:28.694475 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:28.694926 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:28.695373 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:28.839468 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:28.847594 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-5b659b12-42d6-46a2-a595-17793ee39a72 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1265 microversion: 2.1 time: 0.165772 Sep 22 17:18:28.848166 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 618/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:28 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:29.404229 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:29.404812 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:29.411622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.412165 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.412601 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:29.413380 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.413865 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.414293 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:29.428287 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 HTTP/1.1 Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:18:29.430071 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.432017 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '8ebb556d-d6b7-4759-8a5d-e6e5eea385b6'} Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:18:29.432901 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.434213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.436213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:18:29.436213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-e57507c1-201a-49a0-b815-8241c2a717c4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 404 len: 111 microversion: 2.1 time: 0.031361 Sep 22 17:18:29.436213 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 614/1232] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:18:29 2022] DELETE /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:18:29.442150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:29.442810 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:29.448725 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.449249 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.449892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:29.450631 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.451113 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.451538 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:29.464395 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 HTTP/1.1 Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:18:29.466003 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.467593 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '8ebb556d-d6b7-4759-8a5d-e6e5eea385b6'} Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:18:29.468382 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. Sep 22 17:18:29.469610 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.470756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance 8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:18:29.470756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8be33ccc-19ae-4fc1-b082-82f2c1e69cf4 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6" status: 404 len: 111 microversion: 2.1 time: 0.029496 Sep 22 17:18:29.470756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 619/1233] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:29 2022] GET /compute/v2.1/servers/8ebb556d-d6b7-4759-8a5d-e6e5eea385b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:18:29.475826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:29.476320 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:29.482191 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.482671 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.483716 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:29.484753 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.484859 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.485252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:29.502252 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa HTTP/1.1 Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:18:29.503853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.505465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'ae76e1d7-dddd-4528-979a-025f671185aa'} Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:18:29.506527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.508064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.509693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:18:29.509693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-6ff115ce-ece3-4c20-9ae3-56a12482363b tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 404 len: 111 microversion: 2.1 time: 0.033225 Sep 22 17:18:29.509693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 615/1234] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:18:29 2022] DELETE /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:18:29.514037 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:29.514693 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: ae76e1d7-dddd-4528-979a-025f671185aa] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:29.520821 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.521295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.521727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:29.522496 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.522856 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.523305 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:29.537572 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa HTTP/1.1 Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:18:29.539120 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.540829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': 'ae76e1d7-dddd-4528-979a-025f671185aa'} Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:18:29.541734 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. Sep 22 17:18:29.543213 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:29.544811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance ae76e1d7-dddd-4528-979a-025f671185aa could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:18:29.544811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-75d4d711-3950-4d5d-953a-2dd5484cf891 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa" status: 404 len: 111 microversion: 2.1 time: 0.030545 Sep 22 17:18:29.544811 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 620/1235] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:29 2022] GET /compute/v2.1/servers/ae76e1d7-dddd-4528-979a-025f671185aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:18:29.869992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:29.870605 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:29.876613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.877094 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.877514 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:29.878279 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:29.878655 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:29.879100 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:30.014809 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:30.024266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-8d8c99d8-3cb3-49c9-96bc-e6252382eb63 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1452 microversion: 2.1 time: 0.158394 Sep 22 17:18:30.024883 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 616/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:29 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:30.047952 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:30.048599 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:30.055573 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:30.056049 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:30.056480 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:30.057175 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:30.057625 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:30.058044 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:30.188384 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:18:30.197212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f79afdaf-503f-406a-ace9-1c790601dadb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1452 microversion: 2.1 time: 0.154121 Sep 22 17:18:30.197766 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 621/1237] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:30 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:18:30.682284 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:30.683169 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:30.690117 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:30.690677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:30.691203 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:30.691971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:30.692481 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:30.692989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:30.707477 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 HTTP/1.1 Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:18:30.709057 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.710762 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '9f634f38-8ab0-4a46-a568-6bba89fc4bc3'} Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:18:30.711651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.712974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.714613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:18:30.714613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f6d492a3-2722-4036-b0f7-19e2f1304d78 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 404 len: 111 microversion: 2.1 time: 0.032034 Sep 22 17:18:30.714613 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 617/1238] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:18:30 2022] DELETE /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:18:30.719754 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:18:30.720430 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] [instance: 9f634f38-8ab0-4a46-a568-6bba89fc4bc3] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:18:30.726240 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:30.726727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:30.727194 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:30.727892 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:30.728338 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:30.728760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:30.742114 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] HTTP exception thrown: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Request method failure captured: Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 HTTP/1.1 Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZYSmPrmZTQ-yTy4qGJylDrVlvfLgYHzJf_AmV8UXv-UJ4Y0zu17QfoluK0MQ0V5AUPMZhc3Npx81fpPqVVRYV9LM0V51lVNJ8C5u4GT5-9V_dtpwhIe-3eLNW9U4e4uR2V2AG73DlqwmT3VPqMAcSuQ2ftez4I4gJhM1_PFGj5PJE Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:18:30.743692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a6e3ace80a4a43b2b187060d6eca8538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: a6e3ace80a4a43b2b187060d6eca8538 Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1072139309 Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: 5feea3b3b7e4401ea7db242cb60fdfcc Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeNegativeTest-1072139309-project Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.745357 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '9f634f38-8ab0-4a46-a568-6bba89fc4bc3'} Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:18:30.746150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. Sep 22 17:18:30.747432 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:18:30.748560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] Returning 404 to user: Instance 9f634f38-8ab0-4a46-a568-6bba89fc4bc3 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:18:30.748560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-b92c6adc-b519-4310-9bc6-4fac61d210b3 tempest-AttachVolumeNegativeTest-1072139309 tempest-AttachVolumeNegativeTest-1072139309-project] 10.222.0.16 "GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3" status: 404 len: 111 microversion: 2.1 time: 0.030791 Sep 22 17:18:30.748560 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 622/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:18:30 2022] GET /compute/v2.1/servers/9f634f38-8ab0-4a46-a568-6bba89fc4bc3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:18:32.029254 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-21b4f3a0-5a18-4401-9731-c9b0e2fea503 req-75bf69df-51d2-469b-8c13-c3239e6bcb76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67aca1b1-ea8d-44ef-8332-d7d1bed31c9f", "tag": "b87b30f0-d4bd-44de-ab2b-cbd612d168ea"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:18:32.039913 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-21b4f3a0-5a18-4401-9731-c9b0e2fea503 req-75bf69df-51d2-469b-8c13-c3239e6bcb76 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:18:32.040589 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-21b4f3a0-5a18-4401-9731-c9b0e2fea503 req-75bf69df-51d2-469b-8c13-c3239e6bcb76 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:18:32.041052 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-21b4f3a0-5a18-4401-9731-c9b0e2fea503 req-75bf69df-51d2-469b-8c13-c3239e6bcb76 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:18:32.052995 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-21b4f3a0-5a18-4401-9731-c9b0e2fea503 req-75bf69df-51d2-469b-8c13-c3239e6bcb76 service nova] Creating event network-changed:b87b30f0-d4bd-44de-ab2b-cbd612d168ea for instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f on hv-cinder-83538 Sep 22 17:18:32.058360 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-21b4f3a0-5a18-4401-9731-c9b0e2fea503 req-75bf69df-51d2-469b-8c13-c3239e6bcb76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032708 Sep 22 17:18:32.059171 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 618/1240] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:19:09.459212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-d6373346-5922-471f-bcb9-7f04d29841e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:09.461496 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-d6373346-5922-471f-bcb9-7f04d29841e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:09.463756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:19:09.464435 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=48 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:19:09.465655 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 17:19:09.465872 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Thu Sep 22 17:19:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/os-volume_attachments (ip 10.222.0.16) !!! Sep 22 17:19:09.475068 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d6373346-5922-471f-bcb9-7f04d29841e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:09.475619 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d6373346-5922-471f-bcb9-7f04d29841e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:09.476242 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d6373346-5922-471f-bcb9-7f04d29841e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:09.476955 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d6373346-5922-471f-bcb9-7f04d29841e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:09.477420 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d6373346-5922-471f-bcb9-7f04d29841e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:09.477874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-d6373346-5922-471f-bcb9-7f04d29841e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:09.520407 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-d6373346-5922-471f-bcb9-7f04d29841e7 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065472 Sep 22 17:19:09.520976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 623/1241] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 22 17:19:09 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:19:09.586676 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=11 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:19:09.587760 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=32 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:19:09.593544 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:09.594189 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:09.601212 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:09.601748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:09.602183 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:09.602883 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:09.603401 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:09.603828 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:09.632415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:19:09.714575 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-3cf2ecae-623d-47a8-8eda-f849236e9064 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 204 len: 0 microversion: 2.20 time: 0.129316 Sep 22 17:19:09.716122 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 619/1242] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 22 17:19:09 2022] DELETE /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 17:19:09.725868 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:09.726483 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:09.732636 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:09.733125 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:09.733561 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:09.734251 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:09.734924 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:09.735374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:09.878115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:09.886402 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:09.887972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:09.889227 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-0928272d-8855-4ea4-ac74-6325d047f406 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.168169 Sep 22 17:19:09.889750 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 624/1243] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:19:09 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:19:10.917864 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:10.918574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:10.925401 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:10.925887 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:10.926356 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:10.927082 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:10.927542 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:10.927965 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:11.087819 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:11.088352 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:11.089807 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:11.091062 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2cabe336-1708-47d4-bb66-86f10accdb6d tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.177526 Sep 22 17:19:11.091654 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 620/1244] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:19:10 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:19:12.118413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:12.119757 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:12.127443 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:12.128145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:12.139099 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:12.139937 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:12.140455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:12.140891 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:12.381919 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:12.394376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:12.396879 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:12.398840 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-774c1129-e264-4ab7-a94e-f9aa222f8d3f tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1723 microversion: 2.20 time: 0.284479 Sep 22 17:19:12.399918 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 625/1245] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:19:12 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:19:13.016765 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-1b1ecda2-38b9-4b1c-86bf-4fade688f608 req-de170e1d-1138-4476-bb1d-9e3a96149cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3946f917-8585-453c-9eff-81ab4ba3b860", "name": "network-vif-deleted", "tag": "53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:19:13.033488 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1b1ecda2-38b9-4b1c-86bf-4fade688f608 req-de170e1d-1138-4476-bb1d-9e3a96149cbb service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:13.034364 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1b1ecda2-38b9-4b1c-86bf-4fade688f608 req-de170e1d-1138-4476-bb1d-9e3a96149cbb service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:13.035070 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-1b1ecda2-38b9-4b1c-86bf-4fade688f608 req-de170e1d-1138-4476-bb1d-9e3a96149cbb service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:13.048274 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-1b1ecda2-38b9-4b1c-86bf-4fade688f608 req-de170e1d-1138-4476-bb1d-9e3a96149cbb service nova] Creating event network-vif-deleted:53b8fbc8-fbd6-4d70-bc30-e97f7e16eec7 for instance 3946f917-8585-453c-9eff-81ab4ba3b860 on hv-cinder-83538 Sep 22 17:19:13.060520 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-1b1ecda2-38b9-4b1c-86bf-4fade688f608 req-de170e1d-1138-4476-bb1d-9e3a96149cbb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220217 Sep 22 17:19:13.071574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 621/1246] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:19:13.427934 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:13.429429 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:13.440838 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:13.442335 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:13.443005 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:13.443885 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:13.444338 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:13.444886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:13.538541 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:13.539067 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:13.540874 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:13.543923 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.objects.instance [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lazy-loading 'fault' on Instance uuid 3946f917-8585-453c-9eff-81ab4ba3b860 {{(pid=120804) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:19:13.611992 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:13.621886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:13.623765 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b34e9318826c49ed891dde1f7782898b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45847b1fd67c4caaa03a36895cd2263a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:19:13.626323 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1bdeadb4-fad9-4290-9ce3-e91d1e190a81 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 200 len: 1371 microversion: 2.20 time: 0.202283 Sep 22 17:19:13.631086 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 626/1247] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:19:13 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 17:19:14.653900 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:14.654845 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:14.660938 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:14.661418 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:14.661852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:14.662668 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:14.663397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:14.663820 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:14.678290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] HTTP exception thrown: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Request method failure captured: Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 HTTP/1.1 Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZQm7GrAd2Y7_AhTeJO9i6-0Pgkl8T-j1lymY4zz2ebN1uo5n1sJ-EOH-rAZHT2polLoEgi9VDtySpfEic7cBSgaw4zGZNVlN8MGIJ9pymiYHDp3PMJoW8ZFno_C_OWTjnBDbR4lDiPh5V_EbJfxz4fZQp9Q6n-7BBGUoTot5Sw2fk Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:19:14.680451 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: b34e9318826c49ed891dde1f7782898b Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:14.682314 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '3946f917-8585-453c-9eff-81ab4ba3b860'} Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:19:14.683326 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:14.684936 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:14.686620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Returning 404 to user: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:19:14.686620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-0be1e052-f871-4ed3-82f9-413b2439a913 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 404 len: 111 microversion: 2.20 time: 0.033255 Sep 22 17:19:14.686620 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 622/1248] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:19:14 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:19:14.693202 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-bbd3e406-afd0-4085-a630-6a7b25442f80 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '.version_select at 0x7f51dccf83a0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:14.719645 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-bbd3e406-afd0-4085-a630-6a7b25442f80 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970848712" status: 204 len: 0 microversion: 2.20 time: 0.029674 Sep 22 17:19:14.720361 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 627/1249] 10.222.0.16 () {60 vars in 1262 bytes} [Thu Sep 22 17:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970848712 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 17:19:16.541362 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:16.541960 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:16.549693 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:16.550437 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:16.550925 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:16.551646 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:16.552099 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:16.552527 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:16.567685 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] HTTP exception thrown: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Request method failure captured: Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 HTTP/1.1 Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZQm7GrAd2Y7_AhTeJO9i6-0Pgkl8T-j1lymY4zz2ebN1uo5n1sJ-EOH-rAZHT2polLoEgi9VDtySpfEic7cBSgaw4zGZNVlN8MGIJ9pymiYHDp3PMJoW8ZFno_C_OWTjnBDbR4lDiPh5V_EbJfxz4fZQp9Q6n-7BBGUoTot5Sw2fk Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:19:16.569275 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: b34e9318826c49ed891dde1f7782898b Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.570966 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': '3946f917-8585-453c-9eff-81ab4ba3b860'} Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:19:16.571826 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.573385 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.575305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Returning 404 to user: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:19:16.575305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-b7b051f8-da1b-48f9-8f00-87f622707284 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 404 len: 111 microversion: 2.20 time: 0.033663 Sep 22 17:19:16.575305 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 623/1250] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 22 17:19:16 2022] DELETE /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:19:16.587527 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:16.588155 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: 3946f917-8585-453c-9eff-81ab4ba3b860] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:16.595681 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:16.596483 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:16.597027 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:16.597851 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:16.598413 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:16.598994 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:16.614979 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] HTTP exception thrown: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Request method failure captured: Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 HTTP/1.1 Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZQm7GrAd2Y7_AhTeJO9i6-0Pgkl8T-j1lymY4zz2ebN1uo5n1sJ-EOH-rAZHT2polLoEgi9VDtySpfEic7cBSgaw4zGZNVlN8MGIJ9pymiYHDp3PMJoW8ZFno_C_OWTjnBDbR4lDiPh5V_EbJfxz4fZQp9Q6n-7BBGUoTot5Sw2fk Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:19:16.618466 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: b34e9318826c49ed891dde1f7782898b Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.620258 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '3946f917-8585-453c-9eff-81ab4ba3b860'} Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:19:16.621247 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. Sep 22 17:19:16.622836 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:16.624121 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Returning 404 to user: Instance 3946f917-8585-453c-9eff-81ab4ba3b860 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:19:16.624774 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-f7c916d0-7763-40b6-9044-7a4c1b068122 tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860" status: 404 len: 111 microversion: 2.20 time: 0.045080 Sep 22 17:19:16.626220 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 628/1251] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:19:16 2022] GET /compute/v2.1/servers/3946f917-8585-453c-9eff-81ab4ba3b860 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:19:17.807411 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:17.807914 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:17.816163 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:17.816748 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:17.817244 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:17.818012 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:17.818659 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:17.819282 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:17.836391 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] HTTP exception thrown: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Request method failure captured: Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: DELETE /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 HTTP/1.1 Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJZQm7GrAd2Y7_AhTeJO9i6-0Pgkl8T-j1lymY4zz2ebN1uo5n1sJ-EOH-rAZHT2polLoEgi9VDtySpfEic7cBSgaw4zGZNVlN8MGIJ9pymiYHDp3PMJoW8ZFno_C_OWTjnBDbR4lDiPh5V_EbJfxz4fZQp9Q6n-7BBGUoTot5Sw2fk Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:19:17.837985 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: b34e9318826c49ed891dde1f7782898b Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.839844 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2'} Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:19:17.841474 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.843054 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.844852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Returning 404 to user: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:19:17.844852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-25b0ccee-131e-4dcd-b920-5e48b1fd25de tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 404 len: 111 microversion: 2.20 time: 0.037861 Sep 22 17:19:17.844852 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 624/1252] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 22 17:19:17 2022] DELETE /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:19:17.848713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:19:17.849322 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] [instance: eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:19:17.864386 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:17.864888 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:17.865312 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:17.866016 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:19:17.866467 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:19:17.866884 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:19:17.883091 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] HTTP exception thrown: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Request method failure captured: Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 HTTP/1.1 Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJZQm7GrAd2Y7_AhTeJO9i6-0Pgkl8T-j1lymY4zz2ebN1uo5n1sJ-EOH-rAZHT2polLoEgi9VDtySpfEic7cBSgaw4zGZNVlN8MGIJ9pymiYHDp3PMJoW8ZFno_C_OWTjnBDbR4lDiPh5V_EbJfxz4fZQp9Q6n-7BBGUoTot5Sw2fk Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:19:17.884370 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_45847b1fd67c4caaa03a36895cd2263a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 45847b1fd67c4caaa03a36895cd2263a Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-9697682 Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: b34e9318826c49ed891dde1f7782898b Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-AttachVolumeShelveTestJSON-9697682-project Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.886123 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': 'eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2'} Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:19:17.887204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. Sep 22 17:19:17.888472 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:19:17.889710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] Returning 404 to user: Instance eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:19:17.889710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-c7a06feb-3aa9-4c97-b5e2-45b2a5eac01a tempest-AttachVolumeShelveTestJSON-9697682 tempest-AttachVolumeShelveTestJSON-9697682-project] 10.222.0.16 "GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2" status: 404 len: 111 microversion: 2.20 time: 0.040934 Sep 22 17:19:17.889710 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 629/1253] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 22 17:19:17 2022] GET /compute/v2.1/servers/eb952aab-cdd4-4d47-ba6b-0e6dd1db5ee2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 17:21:30.304376 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b4f3eab5-0cbf-4ac3-9656-09e26b7f15b6] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 22 17:21:30.308286 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:30.309453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:21:30.309671 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:30.310794 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG dbcounter [-] [120804] Writing DB stats nova_cell1:SELECT=30 {{(pid=120804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:21:30.312535 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 22 17:21:30.312535 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Thu Sep 22 17:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 22 17:21:30.313657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 17:21:30.313972 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Thu Sep 22 17:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 22 17:21:30.314622 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10147bc2-a3e2-43cc-b3e3-91f4f0091a45] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 22 17:21:30.325828 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 22 17:21:30.326310 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Thu Sep 22 17:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f (ip 10.222.0.16) !!! Sep 22 17:21:30.328439 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:21:30.330387 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG dbcounter [-] [120805] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120805) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 17:21:30.332032 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 17:21:30.332361 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Thu Sep 22 17:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f (ip 10.222.0.16) !!! Sep 22 17:21:30.350440 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:30.351394 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:30.352083 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:30.353104 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:30.353780 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:30.354824 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:30.392048 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:21:30.465713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-73f05967-0d45-456d-8758-480a7b89503e req-b61ec309-7888-4f03-994e-f3af1b1a4032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67aca1b1-ea8d-44ef-8332-d7d1bed31c9f", "tag": "b87b30f0-d4bd-44de-ab2b-cbd612d168ea"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:21:30.491117 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-73f05967-0d45-456d-8758-480a7b89503e req-b61ec309-7888-4f03-994e-f3af1b1a4032 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:30.492426 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-73f05967-0d45-456d-8758-480a7b89503e req-b61ec309-7888-4f03-994e-f3af1b1a4032 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:30.493545 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-73f05967-0d45-456d-8758-480a7b89503e req-b61ec309-7888-4f03-994e-f3af1b1a4032 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:30.509245 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-73f05967-0d45-456d-8758-480a7b89503e req-b61ec309-7888-4f03-994e-f3af1b1a4032 service nova] Creating event network-changed:b87b30f0-d4bd-44de-ab2b-cbd612d168ea for instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f on hv-cinder-83538 Sep 22 17:21:30.514111 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-a023e35a-1b67-4658-b969-ccf7428e3555 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "DELETE /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 204 len: 0 microversion: 2.1 time: 0.213129 Sep 22 17:21:30.519073 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 625/1254] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:21:30 2022] DELETE /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:21:30.520657 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-73f05967-0d45-456d-8758-480a7b89503e req-b61ec309-7888-4f03-994e-f3af1b1a4032 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217839 Sep 22 17:21:30.521334 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 630/1255] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:21:30.523771 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:30.524245 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:30.531574 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:30.531783 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:30.532419 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:30.533130 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:30.533677 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:30.534106 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:30.682249 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:30.690339 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2656bd29-b69c-45e0-9e1e-6ad4c4526a61 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1577 microversion: 2.1 time: 0.171041 Sep 22 17:21:30.691236 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 626/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:30 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 17:21:31.717070 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:31.717699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:31.728026 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO oslo.messaging._drivers.impl_rabbit [-] [b4f3eab5-0cbf-4ac3-9656-09e26b7f15b6] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46826. Sep 22 17:21:31.730732 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:31.731326 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:31.731839 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:31.732556 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:31.733350 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:31.733455 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:31.935314 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:31.943189 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-247a923a-cf23-4c9b-9579-1a0974337305 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1577 microversion: 2.1 time: 0.233224 Sep 22 17:21:31.943760 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 631/1257] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:31 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:21:32.967266 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:32.967974 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:32.975971 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:32.976555 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:32.977052 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:32.977831 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:32.978853 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:32.979298 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:32.996597 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO oslo.messaging._drivers.impl_rabbit [-] [10147bc2-a3e2-43cc-b3e3-91f4f0091a45] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46840. Sep 22 17:21:33.130799 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:33.138922 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-2ac2feb5-be2e-40ec-a113-6b6905fc1fdd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1577 microversion: 2.1 time: 0.175445 Sep 22 17:21:33.139503 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 627/1258] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:32 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:21:34.161669 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:34.162290 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:34.168886 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:34.169373 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:34.169808 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:34.170514 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:34.170992 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:34.171423 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:34.316661 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:34.332042 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-8547b00f-2a1e-45ea-a12f-37754206afeb tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1577 microversion: 2.1 time: 0.174129 Sep 22 17:21:34.332920 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 632/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:34 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:21:35.356426 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:35.357058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:35.364701 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:35.365200 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:35.365636 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:35.366346 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:35.366797 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:35.367251 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:35.528284 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:35.540211 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-c8bc0b42-31ff-4b4d-8e2e-a7a69ca352e9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1577 microversion: 2.1 time: 0.187378 Sep 22 17:21:35.541651 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 628/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:35 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:21:36.565829 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:36.566453 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:36.573713 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:36.574200 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:36.574637 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:36.575373 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:36.575831 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:36.576252 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:36.580408 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [req-06158f91-bc0a-49e3-a725-c76189444bc0 req-e79944e6-c9a0-4118-943c-9fe23915205a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67aca1b1-ea8d-44ef-8332-d7d1bed31c9f", "name": "network-vif-unplugged", "status": "completed", "tag": "b87b30f0-d4bd-44de-ab2b-cbd612d168ea"}]} {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:21:36.591415 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-06158f91-bc0a-49e3-a725-c76189444bc0 req-e79944e6-c9a0-4118-943c-9fe23915205a service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:36.591989 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-06158f91-bc0a-49e3-a725-c76189444bc0 req-e79944e6-c9a0-4118-943c-9fe23915205a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:36.592347 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [req-06158f91-bc0a-49e3-a725-c76189444bc0 req-e79944e6-c9a0-4118-943c-9fe23915205a service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:36.607465 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.compute.server_external_events [req-06158f91-bc0a-49e3-a725-c76189444bc0 req-e79944e6-c9a0-4118-943c-9fe23915205a service nova] Creating event network-vif-unplugged:b87b30f0-d4bd-44de-ab2b-cbd612d168ea for instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f on hv-cinder-83538 Sep 22 17:21:36.614590 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [req-06158f91-bc0a-49e3-a725-c76189444bc0 req-e79944e6-c9a0-4118-943c-9fe23915205a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037768 Sep 22 17:21:36.615579 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 629/1261] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 17:21:36.724893 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:36.733161 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-79434873-4d05-48d5-bcf2-5fb0d571a2cd tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1577 microversion: 2.1 time: 0.170943 Sep 22 17:21:36.733730 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 633/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:36 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:21:37.767223 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:37.768420 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:37.780226 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:37.781156 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:37.782413 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:37.783068 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:37.783609 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:37.784138 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:37.971868 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:37.981920 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-5197a733-69f4-4524-85e4-cd67b506ec49 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1577 microversion: 2.1 time: 0.224661 Sep 22 17:21:37.982992 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 630/1263] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:37 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:21:38.169150 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-6e766a9a-af36-4f86-90f7-df4c93e32fd9 req-df4460b9-2507-4b09-913f-ba02315c8766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67aca1b1-ea8d-44ef-8332-d7d1bed31c9f", "name": "network-vif-deleted", "tag": "b87b30f0-d4bd-44de-ab2b-cbd612d168ea"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:21:38.183090 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-6e766a9a-af36-4f86-90f7-df4c93e32fd9 req-df4460b9-2507-4b09-913f-ba02315c8766 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:38.183566 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-6e766a9a-af36-4f86-90f7-df4c93e32fd9 req-df4460b9-2507-4b09-913f-ba02315c8766 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:38.183992 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-6e766a9a-af36-4f86-90f7-df4c93e32fd9 req-df4460b9-2507-4b09-913f-ba02315c8766 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:38.197001 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-6e766a9a-af36-4f86-90f7-df4c93e32fd9 req-df4460b9-2507-4b09-913f-ba02315c8766 service nova] Creating event network-vif-deleted:b87b30f0-d4bd-44de-ab2b-cbd612d168ea for instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f on hv-cinder-83538 Sep 22 17:21:38.203700 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-6e766a9a-af36-4f86-90f7-df4c93e32fd9 req-df4460b9-2507-4b09-913f-ba02315c8766 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038693 Sep 22 17:21:38.204364 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 634/1264] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:21:39.006602 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:39.007334 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:39.014657 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:39.015295 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:39.015717 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:39.016495 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:39.017140 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:39.017737 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:39.055236 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:39.055722 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:39.056162 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:39.057246 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.objects.instance [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lazy-loading 'fault' on Instance uuid 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f {{(pid=120805) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 17:21:39.104289 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:39.112429 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-258863cc-c45d-411e-9de1-ee6518dfd053 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 200 len: 1184 microversion: 2.1 time: 0.110594 Sep 22 17:21:39.113028 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 631/1265] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:39 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 1184 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:21:40.138756 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:40.139485 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:40.146145 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:40.147264 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:40.147699 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:40.148398 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:40.148842 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:40.149259 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:40.162924 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] HTTP exception thrown: Instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f could not be found. Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Request method failure captured: Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f HTTP/1.1 Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJc4_raI65d81oxfM7Ak-LcDNH7P_Bs6t6No1JjA4Jxvuk2vZgka021i53e3QdmXxUPMdMaabk_zrgKZqZ-jd1kZdl14CeEXxHz1y5hGHugNR35PuCQw5sssJy0E9tpCJ3sHJx4WwOovC_0Oa1fQlpHZUe1ZfKccYHiEWx8MDTxZiCg Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:21:40.164578 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: c2060b33d0a24e01a96ab3fb02b4b045 Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f could not be found. Sep 22 17:21:40.166307 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': '67aca1b1-ea8d-44ef-8332-d7d1bed31c9f'} Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f could not be found. Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:21:40.167431 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f could not be found. Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f could not be found. Sep 22 17:21:40.169517 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:40.171105 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Returning 404 to user: Instance 67aca1b1-ea8d-44ef-8332-d7d1bed31c9f could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:21:40.171105 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-1f953b09-c5ff-42f8-aeed-cae20adcdf17 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f" status: 404 len: 111 microversion: 2.1 time: 0.032659 Sep 22 17:21:40.171105 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 635/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:40 2022] GET /compute/v2.1/servers/67aca1b1-ea8d-44ef-8332-d7d1bed31c9f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:21:43.573502 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:43.574156 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:43.578302 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-0ddd9f57-129e-46a5-a9a1-224c22824c63 req-40b447f3-3fab-400e-bd8a-a02db7dab9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4a1d014-c233-453b-a917-67b7bce065fe", "tag": "719c0d8a-4075-405a-a311-23e6e4817a12"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:21:43.583240 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:43.583736 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:43.584171 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:43.585207 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:43.585666 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:43.586585 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:43.588421 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0ddd9f57-129e-46a5-a9a1-224c22824c63 req-40b447f3-3fab-400e-bd8a-a02db7dab9a3 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:43.588900 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0ddd9f57-129e-46a5-a9a1-224c22824c63 req-40b447f3-3fab-400e-bd8a-a02db7dab9a3 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:43.589325 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-0ddd9f57-129e-46a5-a9a1-224c22824c63 req-40b447f3-3fab-400e-bd8a-a02db7dab9a3 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:43.605454 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-0ddd9f57-129e-46a5-a9a1-224c22824c63 req-40b447f3-3fab-400e-bd8a-a02db7dab9a3 service nova] Creating event network-changed:719c0d8a-4075-405a-a311-23e6e4817a12 for instance d4a1d014-c233-453b-a917-67b7bce065fe on hv-cinder-83538 Sep 22 17:21:43.612027 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-0ddd9f57-129e-46a5-a9a1-224c22824c63 req-40b447f3-3fab-400e-bd8a-a02db7dab9a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038820 Sep 22 17:21:43.612976 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 636/1267] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:21:43.620290 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Going to try to terminate instance {{(pid=120805) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 17:21:43.716532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-01428ed5-4926-4dbc-852c-d66b861a4bb4 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 204 len: 0 microversion: 2.1 time: 0.143996 Sep 22 17:21:43.716532 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 632/1268] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:21:43 2022] DELETE /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 17:21:43.724295 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:43.725065 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:43.731728 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:43.732212 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:43.732643 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:43.733341 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:43.733790 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:43.734210 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:43.881492 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.policy [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120804) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:43.890013 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-242ad482-fe65-43d1-bb9a-ec041f8d70b1 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1576 microversion: 2.1 time: 0.169897 Sep 22 17:21:43.890588 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 637/1269] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:43 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:21:44.913813 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:44.914525 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:44.921630 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:44.922106 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:44.922534 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:44.923241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:44.923680 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:44.924091 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:45.149363 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.policy [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2060b33d0a24e01a96ab3fb02b4b045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fca6eabbca24bc09aee7e259ca82562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120805) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 17:21:45.160870 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-f90cace3-0401-484f-9a89-f75ccc6b76d7 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 200 len: 1458 microversion: 2.1 time: 0.251285 Sep 22 17:21:45.161688 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 633/1270] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:44 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 1458 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 17:21:45.629131 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [req-4d0f5353-a91d-46be-a924-e3500d1f0357 req-e9935624-f0c6-4bd5-adca-97944702d610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4a1d014-c233-453b-a917-67b7bce065fe", "name": "network-vif-deleted", "tag": "719c0d8a-4075-405a-a311-23e6e4817a12"}]} {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 17:21:45.640597 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-4d0f5353-a91d-46be-a924-e3500d1f0357 req-e9935624-f0c6-4bd5-adca-97944702d610 service nova] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:45.641172 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-4d0f5353-a91d-46be-a924-e3500d1f0357 req-e9935624-f0c6-4bd5-adca-97944702d610 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:45.641816 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [req-4d0f5353-a91d-46be-a924-e3500d1f0357 req-e9935624-f0c6-4bd5-adca-97944702d610 service nova] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:45.657345 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.compute.server_external_events [req-4d0f5353-a91d-46be-a924-e3500d1f0357 req-e9935624-f0c6-4bd5-adca-97944702d610 service nova] Creating event network-vif-deleted:719c0d8a-4075-405a-a311-23e6e4817a12 for instance d4a1d014-c233-453b-a917-67b7bce065fe on hv-cinder-83538 Sep 22 17:21:45.663151 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [req-4d0f5353-a91d-46be-a924-e3500d1f0357 req-e9935624-f0c6-4bd5-adca-97944702d610 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037652 Sep 22 17:21:45.663762 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 638/1271] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 22 17:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 17:21:46.190280 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:46.190991 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: d4a1d014-c233-453b-a917-67b7bce065fe] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:46.198014 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:46.198504 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:46.198940 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:46.199673 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:46.200128 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:46.200554 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:46.215709 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] HTTP exception thrown: Instance d4a1d014-c233-453b-a917-67b7bce065fe could not be found. Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Request method failure captured: Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe HTTP/1.1 Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJc4_raI65d81oxfM7Ak-LcDNH7P_Bs6t6No1JjA4Jxvuk2vZgka021i53e3QdmXxUPMdMaabk_zrgKZqZ-jd1kZdl14CeEXxHz1y5hGHugNR35PuCQw5sssJy0E9tpCJ3sHJx4WwOovC_0Oa1fQlpHZUe1ZfKccYHiEWx8MDTxZiCg Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:21:46.217277 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: c2060b33d0a24e01a96ab3fb02b4b045 Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance d4a1d014-c233-453b-a917-67b7bce065fe could not be found. Sep 22 17:21:46.219043 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'd4a1d014-c233-453b-a917-67b7bce065fe'} Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4a1d014-c233-453b-a917-67b7bce065fe could not be found. Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:21:46.220058 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4a1d014-c233-453b-a917-67b7bce065fe could not be found. Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4a1d014-c233-453b-a917-67b7bce065fe could not be found. Sep 22 17:21:46.221781 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.223294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Returning 404 to user: Instance d4a1d014-c233-453b-a917-67b7bce065fe could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:21:46.223294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-350b8712-9f67-4215-8067-2a4416c231d6 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe" status: 404 len: 111 microversion: 2.1 time: 0.032871 Sep 22 17:21:46.223294 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 634/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:46 2022] GET /compute/v2.1/servers/d4a1d014-c233-453b-a917-67b7bce065fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:21:46.733985 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:46.734692 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.compute.api [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120804) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:46.741204 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:46.741687 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:46.742115 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:46.742822 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:46.743296 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:46.743719 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG oslo_concurrency.lockutils [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:46.758156 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.wsgi [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] HTTP exception thrown: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Request method failure captured: Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: request: DELETE /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a HTTP/1.1 Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept: application/json Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Accept-Encoding: identity Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Connection: close Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Length: 0 Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Content-Type: application/json Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Host: 10.222.0.16 Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: Openstack-System-Scope: None Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: User-Agent: python-urllib3/1.26.12 Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Auth-Token: gAAAAABjLJc4_raI65d81oxfM7Ak-LcDNH7P_Bs6t6No1JjA4Jxvuk2vZgka021i53e3QdmXxUPMdMaabk_zrgKZqZ-jd1kZdl14CeEXxHz1y5hGHugNR35PuCQw5sssJy0E9tpCJ3sHJx4WwOovC_0Oa1fQlpHZUe1ZfKccYHiEWx8MDTxZiCg Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Id: None Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Domain-Name: None Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Identity-Status: Confirmed Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Is-Admin-Project: True Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Id: default Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Domain-Name: Default Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Project-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Role: member,reader Sep 22 17:21:46.760374 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Roles: member,reader Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-Tenant-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Id: default Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Domain-Name: Default Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Id: c2060b33d0a24e01a96ab3fb02b4b045 Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: X-User-Name: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: method: > Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: exception: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.762116 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: action_args: {'id': 'b6348b1f-b623-42cb-a0dc-a33cf088486a'} Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:21:46.763400 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.765021 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.766776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Returning 404 to user: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. {{(pid=120804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:21:46.766776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-a5efd407-5eca-4fc5-8cad-3f0b1802e1bc tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 404 len: 111 microversion: 2.1 time: 0.032733 Sep 22 17:21:46.766776 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 639/1273] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 22 17:21:46 2022] DELETE /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:21:46.770867 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '>' {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:46.771501 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.compute.api [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] [instance: b6348b1f-b623-42cb-a0dc-a33cf088486a] Fetching instance by UUID {{(pid=120805) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 17:21:46.778397 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:46.778880 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:46.779330 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:46.780026 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Acquiring lock "95a4f068-962a-4171-97c1-e00db3557f02" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 17:21:46.780530 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 17:21:46.780918 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG oslo_concurrency.lockutils [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Lock "95a4f068-962a-4171-97c1-e00db3557f02" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120805) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 17:21:46.795557 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.wsgi [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] HTTP exception thrown: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Request method failure captured: Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: request: GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a HTTP/1.1 Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept: application/json Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Accept-Encoding: identity Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Connection: close Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Length: 0 Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Content-Type: application/json Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Host: 10.222.0.16 Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: Openstack-System-Scope: None Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: User-Agent: python-urllib3/1.26.12 Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Auth-Token: gAAAAABjLJc4_raI65d81oxfM7Ak-LcDNH7P_Bs6t6No1JjA4Jxvuk2vZgka021i53e3QdmXxUPMdMaabk_zrgKZqZ-jd1kZdl14CeEXxHz1y5hGHugNR35PuCQw5sssJy0E9tpCJ3sHJx4WwOovC_0Oa1fQlpHZUe1ZfKccYHiEWx8MDTxZiCg Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Id: None Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Domain-Name: None Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Identity-Status: Confirmed Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Is-Admin-Project: True Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Id: default Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Domain-Name: Default Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Project-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Role: member,reader Sep 22 17:21:46.797241 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Roles: member,reader Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5fca6eabbca24bc09aee7e259ca82562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Id: 5fca6eabbca24bc09aee7e259ca82562 Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-Tenant-Name: tempest-TestVolumeBootPattern-85944829 Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Id: default Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Domain-Name: Default Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Id: c2060b33d0a24e01a96ab3fb02b4b045 Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: X-User-Name: tempest-TestVolumeBootPattern-85944829-project Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: method: > Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: exception: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.799064 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: action_args: {'id': 'b6348b1f-b623-42cb-a0dc-a33cf088486a'} Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: {{(pid=120805) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 17:21:46.800075 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. Sep 22 17:21:46.801884 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: ERROR nova.api.openstack.wsgi Sep 22 17:21:46.803161 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: DEBUG nova.api.openstack.wsgi [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Returning 404 to user: Instance b6348b1f-b623-42cb-a0dc-a33cf088486a could not be found. {{(pid=120805) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 17:21:46.803161 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: INFO nova.api.openstack.requestlog [None req-38eb6cc0-9465-4f89-b7dc-ca129a2122ed tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a" status: 404 len: 111 microversion: 2.1 time: 0.032732 Sep 22 17:21:46.803161 dv-cinder-835384-28-iscsi devstack@n-api.service[120805]: [pid: 120805|app: 0|req: 635/1274] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 22 17:21:46 2022] GET /compute/v2.1/servers/b6348b1f-b623-42cb-a0dc-a33cf088486a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 17:21:48.117604 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: DEBUG nova.api.openstack.wsgi [None req-cd5d072c-2519-4a7a-9123-45ae099482b9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] Calling method '.version_select at 0x7f51dcd035e0>' {{(pid=120804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 17:21:48.140727 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: INFO nova.api.openstack.requestlog [None req-cd5d072c-2519-4a7a-9123-45ae099482b9 tempest-TestVolumeBootPattern-85944829 tempest-TestVolumeBootPattern-85944829-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-880029579" status: 202 len: 0 microversion: 2.1 time: 0.026805 Sep 22 17:21:48.142154 dv-cinder-835384-28-iscsi devstack@n-api.service[120804]: [pid: 120804|app: 0|req: 640/1275] 10.222.0.16 () {58 vars in 1260 bytes} [Thu Sep 22 17:21:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-880029579 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)